-- Logs begin at Wed 2022-05-25 14:41:12 UTC, end at Wed 2022-05-25 16:11:00 UTC. -- May 25 15:37:34.155245 dv-osbrick-836391-10-ceph systemd[1]: Starting Devstack devstack@keystone.service... May 25 15:37:34.163309 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 25 15:37:34.167231 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 15:37:34 2022] *** May 25 15:37:34.167231 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 15:37:34.167231 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 15:37:34.167231 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: nodename: dv-osbrick-836391-10-ceph May 25 15:37:34.167231 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: machine: x86_64 May 25 15:37:34.167231 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: clock source: unix May 25 15:37:34.167231 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: pcre jit disabled May 25 15:37:34.167231 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: detected number of CPU cores: 4 May 25 15:37:34.167231 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: current working directory: / May 25 15:37:34.167231 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: detected binary path: /usr/bin/uwsgi-core May 25 15:37:34.167231 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: your processes number limit is 47680 May 25 15:37:34.167231 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: your memory page size is 4096 bytes May 25 15:37:34.167231 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: detected max file descriptor number: 2048 May 25 15:37:34.167231 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: lock engine: pthread robust mutexes May 25 15:37:34.167231 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: thunder lock: enabled May 25 15:37:34.167231 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 25 15:37:34.167231 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 15:37:34.216243 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: Python main interpreter initialized at 0x55932e2629c0 May 25 15:37:34.216243 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: python threads support enabled May 25 15:37:34.216243 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: your server socket listen backlog is limited to 100 connections May 25 15:37:34.216243 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: your mercy for graceful operations on workers is 90 seconds May 25 15:37:34.216702 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: mapped 403077 bytes (393 KB) for 2 cores May 25 15:37:34.216702 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: *** Operational MODE: preforking *** May 25 15:37:34.216979 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: *** uWSGI is running in multiple interpreter mode *** May 25 15:37:34.216979 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: spawned uWSGI master process (pid: 99243) May 25 15:37:34.217191 dv-osbrick-836391-10-ceph systemd[1]: Started Devstack devstack@keystone.service. May 25 15:37:34.221211 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: spawned uWSGI worker 1 (pid: 99258, cores: 1) May 25 15:37:34.221211 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: spawned uWSGI worker 2 (pid: 99259, cores: 1) May 25 15:37:34.221211 dv-osbrick-836391-10-ceph devstack@keystone.service[99243]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 15:37:40.114478 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:37:40.114478 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: from cryptography.utils import int_from_bytes May 25 15:37:40.115904 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:37:40.115904 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: from cryptography.utils import int_from_bytes May 25 15:37:40.147533 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:37:40.147533 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: from cryptography.utils import int_from_bytes May 25 15:37:40.148054 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 15:37:40.148054 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: from cryptography.utils import int_from_bytes May 25 15:37:40.165436 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 15:37:40.165634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 15:37:40.165829 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] command line args: [] {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 15:37:40.166107 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 15:37:40.166286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ================================================================================ {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 15:37:40.166542 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] admin_token = **** {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.166790 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] config_dir = [] {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.166977 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.167158 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] config_source = [] {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.167338 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] debug = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.167536 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.168831 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.168831 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] insecure_debug = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.168831 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.168831 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.168831 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] list_limit = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.169331 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] log_config_append = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.169331 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.169331 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] log_dir = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.169620 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] log_file = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.169699 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.169930 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.170179 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.170427 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.170607 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.170783 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.171026 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.171317 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.171640 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.171946 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.172340 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.172809 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.172943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.173149 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] notification_format = cadf {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.173440 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.173926 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.174110 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] publish_errors = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.174345 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.174578 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.174759 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.175009 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.175245 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.175485 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] standard_threads = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.175718 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] strict_password_check = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.175964 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.176142 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] use_eventlog = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.176319 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] use_journal = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.176521 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] use_json = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.176702 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] use_stderr = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.176876 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] use_syslog = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.177111 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] watch_log_file = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.177373 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.177613 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.177874 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.178115 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.178366 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.178606 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.178858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.179095 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.179343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.179592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.179847 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.180082 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.180329 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.180588 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.180838 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.181089 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.181369 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.181577 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.181833 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.182081 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.182316 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.182571 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.182836 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.183090 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.183341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.183574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.183831 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.184067 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.184303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.184580 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.184833 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.185067 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.185300 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.185550 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.185801 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.186052 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.186305 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.186541 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.187333 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.187543 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.187776 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.188183 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.188433 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.188672 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.188913 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.189168 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.189407 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.189645 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.189879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.190119 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.190358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.190609 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.190843 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.191084 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.191324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.191563 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.191800 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.192037 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.192268 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.192549 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.192791 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.193029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.193261 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.193539 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.193759 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.193990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.194227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.194463 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.194732 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.194970 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.195218 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.195461 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.195706 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.195933 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.196168 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.196246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 15:37:40.196405 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 15:37:40.196532 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.enabled = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.196628 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] command line args: [] {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 15:37:40.196705 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.196885 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.196964 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 15:37:40.197074 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ================================================================================ {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 15:37:40.197156 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.197330 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] admin_token = **** {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.197414 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.197570 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.197649 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] config_dir = [] {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.197757 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.197840 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.197942 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] config_source = [] {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.198018 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.198122 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] debug = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.198246 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.198330 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.198506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.198585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.198721 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] insecure_debug = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.198799 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.198971 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.199048 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.199207 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.199286 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.199436 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] list_limit = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.199514 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.199617 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] log_config_append = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.199700 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.199795 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.199901 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.199986 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] log_dir = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.200135 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.200213 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] log_file = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.200366 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.200474 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.200621 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.200709 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.200850 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.200927 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.201117 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.201236 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.201332 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.201406 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.201476 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.201587 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.201702 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.201823 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.201948 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.202072 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.202181 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.202311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.202464 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.203256 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.203352 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.203506 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.203586 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.203758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.203849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.203990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] auth.external = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.204096 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] notification_format = cadf {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.204222 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] auth.mapped = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.204378 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.204556 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.204792 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.205003 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.62/identity {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.205103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] auth.password = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.205183 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] publish_errors = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.205256 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] auth.token = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.205411 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.205501 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.205642 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.205722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] catalog.caching = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.205821 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.205923 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.206070 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.206148 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.206306 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.206392 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.206546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] standard_threads = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.206641 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.206777 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] strict_password_check = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.206863 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.207020 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.207108 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] credential.caching = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.207187 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] use_eventlog = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.207294 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] credential.driver = sql {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.207373 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] use_journal = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.207523 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] use_json = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.207609 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.207776 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.207860 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] use_stderr = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.207980 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] use_syslog = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.208064 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.208218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] watch_log_file = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 15:37:40.208374 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.208473 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.208598 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.208729 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.208808 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.208983 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.209078 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.209222 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.209306 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.209471 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.209633 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.209721 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.209803 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.209952 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.210031 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.210191 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.210275 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.210440 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.210526 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.210690 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.210769 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.210943 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.211027 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] federation.caching = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.211177 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.211271 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.211423 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.211502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] federation.driver = sql {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.211663 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.211740 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.211890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.211967 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.212147 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.212248 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.212397 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.212538 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.212673 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.212788 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.212896 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.212993 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.213151 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.213257 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.213387 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.213507 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.213634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.213740 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.213879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] identity.caching = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.213982 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.214128 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.214238 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.214375 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.214488 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.214599 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.214695 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.214829 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.214934 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.215049 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.215153 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] identity.driver = sql {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.215289 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.215394 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.215521 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.215639 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.215769 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.215873 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.216000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.216109 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.216234 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.216346 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.216477 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.216587 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.216704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.216809 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.216951 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.217076 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.217200 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.217313 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.217447 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.217559 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.217684 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.217800 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.217922 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.218076 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.218228 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.218373 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.218474 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.219202 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.219315 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.219428 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.219539 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.219643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.219723 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.219808 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.219910 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.220003 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.220073 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.220185 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.220291 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.220395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.220575 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.220575 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.220776 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.220864 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.220940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.221011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.221082 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.221162 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.221235 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.221307 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.221379 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.221497 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.221574 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.221699 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.221778 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.221914 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.221994 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.222151 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.222229 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.222401 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.password = **** {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.222479 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.222605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.222685 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.222838 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.222915 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.223079 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.223164 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.223314 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.223399 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.223550 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.223630 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.223799 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.223887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.224035 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.224115 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.224262 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.224339 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.224533 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.224656 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.224783 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.224910 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.225029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.225185 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.225276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.225426 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.225506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.225677 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.225755 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.225951 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.226047 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.user = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.226166 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.226244 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.226400 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.226484 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.226639 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.226738 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.226886 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.226965 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.enabled = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.227122 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.227200 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.227360 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.227447 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.227602 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.227682 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.227831 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.227909 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.228066 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.228156 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.228298 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.228377 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.228553 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.228633 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.228789 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.228891 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.229035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.229116 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.229280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.229359 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.229520 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.229613 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.229802 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.229891 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.230042 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.230122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.230272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.230359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.230517 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.230596 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.230753 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.230839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.230981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.231068 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.231214 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.231294 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.231446 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.231523 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.231679 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.231765 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.231910 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.231993 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.232149 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.232227 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.232383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.232495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] policy.driver = sql {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.232646 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.232731 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.232882 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.232960 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.233115 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.233201 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.233350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] receipt.caching = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.233429 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.233587 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.234167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.234362 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.234479 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] auth.external = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.234603 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.234748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] auth.mapped = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.234835 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.235075 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.235265 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.235367 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.235455 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] resource.caching = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.235601 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] auth.password = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.235681 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.235834 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] auth.token = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.235922 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] resource.driver = sql {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.236075 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.236155 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.236311 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] catalog.caching = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.236391 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.236584 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.236681 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.236817 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.236897 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] revoke.caching = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.237062 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.237139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.237298 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.237386 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.237527 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.237605 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] role.cache_time = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.237758 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] role.caching = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.237836 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] credential.caching = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.238017 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] credential.driver = sql {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.238106 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] role.driver = sql {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.238252 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] role.list_limit = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.238333 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.238502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.238581 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.238738 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.238831 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.238987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.239067 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.239221 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.239299 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.239480 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.239571 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.239728 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.239807 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.239963 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.240045 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.240215 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.240300 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.240487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.240573 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.240731 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.240848 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.240993 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.241094 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.241240 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.241322 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.241487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.241567 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.241746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] federation.caching = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.241936 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.242024 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.242154 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.242235 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] federation.driver = sql {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.242405 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.242485 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.242655 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.242738 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.242903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.242983 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.243140 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.243227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.243373 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.243453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.243617 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.243695 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.243867 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.243954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.244102 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.244181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.244332 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.244440 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.244588 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.244682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] identity.caching = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.244821 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.244903 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.245070 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.245148 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.245306 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.245465 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.245542 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.245615 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.245776 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] identity.driver = sql {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.245856 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.246006 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.246095 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.246234 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] token.cache_time = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.246313 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.246469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] token.caching = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.246548 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.246705 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.246793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.246936 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.247019 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] token.provider = fernet {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.247168 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.247249 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.247424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.247521 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.247669 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.247757 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.247907 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.247987 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.248153 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.248242 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.248398 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.248500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.248674 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] trust.driver = sql {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.248756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.248910 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.248999 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.249162 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.249242 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.249454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.250265 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.250361 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.250448 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.250523 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.250664 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.250840 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.250920 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.251089 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.251178 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.251328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.251431 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] database.connection = **** {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.251574 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.251664 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.251817 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.251897 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.252069 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.252152 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.252301 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.252381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.252609 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.252700 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.252860 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.252942 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.253098 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.253177 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.253336 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.253416 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.253580 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.253661 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.253813 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.253892 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.254051 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.254130 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.254283 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.254365 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.password = **** {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.254520 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.254642 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.254761 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.254839 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.254991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.255074 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.255220 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.255299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.255454 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.255533 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.255689 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.255769 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.255862 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=99259) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 15:37:40.255949 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.256160 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.256394 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.256667 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.256916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.257153 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.257445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.257627 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.257857 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.user = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.258099 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.258357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.258590 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.258840 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.259087 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.259333 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.259570 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.259801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.260035 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.260268 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.260536 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.260768 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.261015 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.261262 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.261508 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.261755 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.262001 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.262231 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.262478 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.262716 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.262950 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.263190 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.263430 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.263755 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.263959 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.264204 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.264477 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] policy.driver = sql {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.264712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.265034 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.265489 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.265740 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] receipt.caching = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.265959 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.266209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.266454 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.266689 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.266929 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.267171 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] resource.caching = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.267422 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.267675 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] resource.driver = sql {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.267913 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.268166 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.268437 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.268677 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] revoke.caching = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.269183 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.269420 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.269659 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] role.cache_time = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.269895 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] role.caching = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.270143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] role.driver = sql {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.270373 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] role.list_limit = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.270634 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.270883 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.271149 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.271383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.271630 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.271879 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.272127 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.272375 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.272642 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.272893 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.273143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.273391 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.273640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.274079 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.274314 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.274564 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.274812 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.275061 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.275311 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.275546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.275799 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.276187 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.276497 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.276689 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.276923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.277156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.277408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.277666 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.277914 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.278152 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.278389 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.278619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] token.cache_time = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.278854 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] token.caching = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.279092 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.279342 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] token.provider = fernet {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.279578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.279835 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.280083 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.280324 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.280617 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.280960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.281269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] trust.driver = sql {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.281508 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.281749 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.281984 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.282229 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.282478 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.282708 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.283021 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.283343 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.283606 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] database.connection = **** {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.283853 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.284107 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.284345 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.284612 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.284847 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.285082 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.285319 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.285555 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.285802 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.286036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.286282 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.286517 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.286878 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.287125 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.287371 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.287453 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.287607 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.287687 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.287835 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.287922 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.288069 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 15:37:40.288241 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=99258) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 15:37:40.297351 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.316597 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.316826 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.317052 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.326388 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.334011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.334248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.345906 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.346141 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.405204 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.405380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.456656 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.456899 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.457191 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.457434 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.525409 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.525639 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.525730 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.525862 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.525970 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.526086 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.526223 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.526303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.526404 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.526533 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.526616 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.526835 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.552650 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.552823 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.552912 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.552990 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.553095 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.553177 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.553322 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.553403 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.553545 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.553628 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.553764 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.553844 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.553982 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.554072 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.565787 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.566270 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.591530 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.591707 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.591822 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.591973 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.592056 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.592205 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.592384 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.592553 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.592669 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.592785 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.592891 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=99259) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.593661 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.594083 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.594447 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=99258) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 15:37:40.611303 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.611494 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.611625 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 15:37:40.611800 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 15:37:40.611942 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.612058 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.612179 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 15:37:40.612298 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 15:37:40.612449 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.612570 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.612760 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.612874 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.613042 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.613228 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.613408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.613583 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.624785 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.625025 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.625124 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.625324 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.625471 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.625628 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.625750 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.626032 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.633821 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=99258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.634278 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=99259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.637263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=99258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.637542 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.637716 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=99259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.637829 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.637999 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.638097 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.638284 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.638366 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.638565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.638647 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.638848 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.638940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.639109 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.639189 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.639378 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.639457 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.639649 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.639729 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.639966 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.640108 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.640301 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.640598 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.667867 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.668567 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.669486 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=99258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.669772 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.670225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=99259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.670508 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.676004 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=99258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.676293 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.676562 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=99259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.676653 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.676854 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.677137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.684294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=99258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.684612 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.685029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=99259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.685332 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.689404 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=99258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.689708 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.689996 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.690159 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=99259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.690279 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.690469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.690559 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.690755 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.690844 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.691038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.691129 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.691319 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.691408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.691598 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.691869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.692139 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.710878 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.711180 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.711888 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.712193 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.715993 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=99258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.717212 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=99259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.720758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.721084 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.721732 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.722044 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.726339 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=99258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.727225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=99259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.730268 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=99258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.731312 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=99259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.734684 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.735002 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.735415 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.735562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.735845 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.736135 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.736401 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.736819 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.737187 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.737554 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.737941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.738313 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.756030 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=99258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.756332 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.756631 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.756900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.758919 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=99259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.759219 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.759490 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.759754 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.765135 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.767075 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.767352 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.768244 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.770325 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.770605 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.770705 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=99258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.770991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.771276 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.771562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.771975 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.773689 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=99259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.774076 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.774364 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.774645 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.775052 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.785916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=99258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.786199 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.786478 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.786766 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.787050 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.787336 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.787615 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.789069 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=99259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.789350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.789628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.789905 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.790193 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.790470 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.790764 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.805958 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=99258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.809030 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=99259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.809250 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=99258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.813012 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=99259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.813191 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.814817 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.816379 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.816561 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=99258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.818032 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.818122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.818334 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.819703 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=99259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.821418 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.821711 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.825702 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.827331 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=99258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.829182 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.830664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.830787 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=99259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.830958 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.831246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.831535 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.834063 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.834353 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.834643 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.834920 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.840880 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=99258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.841171 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.841463 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.844878 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=99259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.845166 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.845450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.850068 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=99258) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.850352 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.850632 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.850909 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.851182 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.851455 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.851729 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.852017 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.852287 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.852622 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.852999 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.853274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.853364 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=99259) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 15:37:40.853544 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.853624 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.853814 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=99258) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.853893 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.854145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.854415 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.854695 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.854982 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.855250 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.855525 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.855800 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.856171 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.856455 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.856742 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.857003 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=99259) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 15:37:40.893233 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55932e2629c0 pid: 99258 (default app) May 25 15:37:40.897292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd1241-5e8c-439d-872d-48ffe1f14269 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:40.897585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd1241-5e8c-439d-872d-48ffe1f14269 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:40.897723 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55932e2629c0 pid: 99259 (default app) May 25 15:37:40.897868 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebd1241-5e8c-439d-872d-48ffe1f14269 None None] PATH_INFO: `/v3` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:40.902412 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 1/1] 10.222.0.62 () {50 vars in 791 bytes} [Wed May 25 15:37:40 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:37:50.294005 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de80005-d3df-43b4-b08d-8cb4f74aea28 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:50.294579 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de80005-d3df-43b4-b08d-8cb4f74aea28 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:50.294579 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de80005-d3df-43b4-b08d-8cb4f74aea28 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:50.299175 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 1/2] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:37:50 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:37:50.305076 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9887b-710f-4f08-9a3b-8256db9d857c None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:50.305737 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9887b-710f-4f08-9a3b-8256db9d857c None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:50.305737 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9887b-710f-4f08-9a3b-8256db9d857c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:50.379164 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: INFO dbcounter [None req-53b9887b-710f-4f08-9a3b-8256db9d857c None None] Registered counter for database keystone May 25 15:37:50.401639 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG oslo_db.sqlalchemy.engines [None req-53b9887b-710f-4f08-9a3b-8256db9d857c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99258) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:37:50.409491 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writer thread running {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 15:37:50.716271 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG passlib.handlers.bcrypt [None req-53b9887b-710f-4f08-9a3b-8256db9d857c None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=99258) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 15:37:50.716652 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG passlib.handlers.bcrypt [None req-53b9887b-710f-4f08-9a3b-8256db9d857c None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=99258) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 15:37:50.776492 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-53b9887b-710f-4f08-9a3b-8256db9d857c None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:50.778170 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-53b9887b-710f-4f08-9a3b-8256db9d857c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:50.912036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 2/3] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:37:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 608 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) May 25 15:37:51.074171 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de80005-d3df-43b4-b08d-8cb4f74aea28 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:51.150475 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: INFO dbcounter [None req-4de80005-d3df-43b4-b08d-8cb4f74aea28 None None] Registered counter for database keystone May 25 15:37:51.171790 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG oslo_db.sqlalchemy.engines [None req-4de80005-d3df-43b4-b08d-8cb4f74aea28 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=99259) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 15:37:51.178531 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writer thread running {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 15:37:51.299629 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de80005-d3df-43b4-b08d-8cb4f74aea28 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:51.303910 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f4a734-059f-4228-9a7a-0d003c552393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:51.304618 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4a734-059f-4228-9a7a-0d003c552393 admin admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:51.304902 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4a734-059f-4228-9a7a-0d003c552393 admin admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:51.305177 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f4a734-059f-4228-9a7a-0d003c552393 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:51.314576 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4a734-059f-4228-9a7a-0d003c552393 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:51.473322 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: WARNING keystone.common.rbac_enforcer.enforcer [None req-90f4a734-059f-4228-9a7a-0d003c552393 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 15:37:51.473582 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f4a734-059f-4228-9a7a-0d003c552393 admin admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:51.484701 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 2/4] 10.222.0.62 () {58 vars in 1324 bytes} [Wed May 25 15:37:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:37:51.490967 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9887b-710f-4f08-9a3b-8256db9d857c None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:51.506635 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9887b-710f-4f08-9a3b-8256db9d857c None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:51.510987 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0203dc-b8de-418e-a84c-3c4f2e73099a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:51.512134 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0203dc-b8de-418e-a84c-3c4f2e73099a admin admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:51.512431 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0203dc-b8de-418e-a84c-3c4f2e73099a admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:51.512715 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0203dc-b8de-418e-a84c-3c4f2e73099a admin admin] PATH_INFO: `/v3/projects/7b5e6c2944d540b0b18682f21c8da32d` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:51.514222 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0203dc-b8de-418e-a84c-3c4f2e73099a admin admin] RBAC: Authorizing `identity:get_project(project_id=7b5e6c2944d540b0b18682f21c8da32d)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:51.570670 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ce0203dc-b8de-418e-a84c-3c4f2e73099a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 15:37:51.571010 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0203dc-b8de-418e-a84c-3c4f2e73099a admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:51.575861 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 3/5] 10.222.0.62 () {56 vars in 1207 bytes} [Wed May 25 15:37:51 2022] GET /identity/v3/projects/7b5e6c2944d540b0b18682f21c8da32d => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:37:53.875152 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25791873-d212-44c7-b315-766487b4f2df None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:53.875695 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25791873-d212-44c7-b315-766487b4f2df None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:53.875872 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25791873-d212-44c7-b315-766487b4f2df None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:53.880248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 3/6] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:37:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:37:53.886646 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a31434-bcca-4071-a80a-d8b6180c1f6b None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:53.887178 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a31434-bcca-4071-a80a-d8b6180c1f6b None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:53.887264 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a31434-bcca-4071-a80a-d8b6180c1f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:53.907702 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-99a31434-bcca-4071-a80a-d8b6180c1f6b None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:53.909336 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-99a31434-bcca-4071-a80a-d8b6180c1f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:53.917506 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 4/7] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:37:53 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 15:37:53.942653 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25791873-d212-44c7-b315-766487b4f2df None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:53.955044 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25791873-d212-44c7-b315-766487b4f2df None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:53.959353 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4b15b-0891-4e2e-8d1d-3cd49443cac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:53.959992 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4b15b-0891-4e2e-8d1d-3cd49443cac0 admin admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:53.960280 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4b15b-0891-4e2e-8d1d-3cd49443cac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:53.960595 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4b15b-0891-4e2e-8d1d-3cd49443cac0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:53.968487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4b15b-0891-4e2e-8d1d-3cd49443cac0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:53.970284 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d4b15b-0891-4e2e-8d1d-3cd49443cac0 admin admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:53.979133 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 4/8] 10.222.0.62 () {58 vars in 1324 bytes} [Wed May 25 15:37:53 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 15:37:53.986846 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a31434-bcca-4071-a80a-d8b6180c1f6b None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:53.996132 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a31434-bcca-4071-a80a-d8b6180c1f6b None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:54.001332 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8c946e-62b1-46c2-a273-23b84561c685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:54.002209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c946e-62b1-46c2-a273-23b84561c685 admin admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:54.002486 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c946e-62b1-46c2-a273-23b84561c685 admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:54.002761 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c946e-62b1-46c2-a273-23b84561c685 admin admin] PATH_INFO: `/v3/users/c9c77caa8ec1422eb63723b3db112685` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:54.004183 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c946e-62b1-46c2-a273-23b84561c685 admin admin] RBAC: Authorizing `identity:get_user(user_id=c9c77caa8ec1422eb63723b3db112685)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:54.006055 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8c946e-62b1-46c2-a273-23b84561c685 admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:54.007643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 5/9] 10.222.0.62 () {56 vars in 1198 bytes} [Wed May 25 15:37:53 2022] GET /identity/v3/users/c9c77caa8ec1422eb63723b3db112685 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:37:56.416408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440cc6e-a4eb-463a-b15c-0e5651985f2a None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:56.416921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440cc6e-a4eb-463a-b15c-0e5651985f2a None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:56.417044 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8eba0-a797-4d6e-9e9a-dc35fafef126 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:56.417380 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8440cc6e-a4eb-463a-b15c-0e5651985f2a None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:56.417450 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8eba0-a797-4d6e-9e9a-dc35fafef126 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:56.417450 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8eba0-a797-4d6e-9e9a-dc35fafef126 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:56.418309 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 5/10] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:37:56.418785 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 6/11] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:37:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:37:56.423318 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21b86c-7838-424e-ac71-c9c48c6d74fe None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:56.423608 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21b86c-7838-424e-ac71-c9c48c6d74fe None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:56.423885 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21b86c-7838-424e-ac71-c9c48c6d74fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:56.424638 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1597f0-98ce-44c1-93ff-54f9699318f7 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:56.424935 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1597f0-98ce-44c1-93ff-54f9699318f7 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:56.425264 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1597f0-98ce-44c1-93ff-54f9699318f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:56.442873 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-4b1597f0-98ce-44c1-93ff-54f9699318f7 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:56.444098 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-4b1597f0-98ce-44c1-93ff-54f9699318f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:56.464472 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG passlib.handlers.bcrypt [None req-0d21b86c-7838-424e-ac71-c9c48c6d74fe None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=99259) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 15:37:56.464895 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG passlib.handlers.bcrypt [None req-0d21b86c-7838-424e-ac71-c9c48c6d74fe None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=99259) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 15:37:56.512698 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-0d21b86c-7838-424e-ac71-c9c48c6d74fe None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:37:56.514304 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-0d21b86c-7838-424e-ac71-c9c48c6d74fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:37:56.531659 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 7/12] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:37:56.557797 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1597f0-98ce-44c1-93ff-54f9699318f7 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:56.584189 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:56.626320 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 6/13] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:37:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:37:56.649787 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21b86c-7838-424e-ac71-c9c48c6d74fe None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:56.667127 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1597f0-98ce-44c1-93ff-54f9699318f7 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:56.701864 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0deaf-00e2-4fa9-a316-0c416ff36e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:56.703285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0deaf-00e2-4fa9-a316-0c416ff36e60 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:56.703579 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0deaf-00e2-4fa9-a316-0c416ff36e60 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:56.703851 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae0deaf-00e2-4fa9-a316-0c416ff36e60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:56.715268 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae0deaf-00e2-4fa9-a316-0c416ff36e60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:37:56.727294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-aae0deaf-00e2-4fa9-a316-0c416ff36e60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:37:56.727294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:37:56.727294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:37:56.727294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:37:56.727294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:37:56.727294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:37:56.727294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:37:56.727294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:37:56.727294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:37:56.727294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:37:56.727294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:37:56.727294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:37:56.727294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:37:56.727294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:37:56.727294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:37:56.727294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:37:56.728360 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:37:56.728360 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:37:56.728360 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:37:56.728360 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:37:56.728360 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:37:56.728360 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:37:56.728360 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:37:56.728360 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:37:56.728360 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:37:56.728360 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:37:56.728360 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:37:56.728360 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:37:56.728360 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:37:56.728360 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:37:56.728360 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:37:56.728360 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:37:56.729270 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:37:56.729270 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:37:56.729270 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:37:56.729270 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:37:56.729270 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:37:56.729270 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:37:56.729270 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:37:56.729270 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:37:56.729270 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:37:56.729270 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:37:56.729270 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:37:56.729270 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:37:56.729270 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 8/14] 10.222.0.62 () {56 vars in 1096 bytes} [Wed May 25 15:37:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:37:56.734536 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0deaf-00e2-4fa9-a316-0c416ff36e60 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:56.761137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21b86c-7838-424e-ac71-c9c48c6d74fe None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:56.763761 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:56.806736 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98786b9-5bac-4eb9-8ce5-4727d2ddbb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:56.811499 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98786b9-5bac-4eb9-8ce5-4727d2ddbb6d None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:56.811499 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98786b9-5bac-4eb9-8ce5-4727d2ddbb6d None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:56.811499 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98786b9-5bac-4eb9-8ce5-4727d2ddbb6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:56.825436 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:56.848484 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae0deaf-00e2-4fa9-a316-0c416ff36e60 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:56.885087 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba49d2-3de4-4d45-a7b1-049866016576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:56.885659 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98786b9-5bac-4eb9-8ce5-4727d2ddbb6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:56.885767 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba49d2-3de4-4d45-a7b1-049866016576 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:56.886063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba49d2-3de4-4d45-a7b1-049866016576 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:56.886342 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ba49d2-3de4-4d45-a7b1-049866016576 None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:56.887108 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba49d2-3de4-4d45-a7b1-049866016576 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:37:56.890546 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98786b9-5bac-4eb9-8ce5-4727d2ddbb6d None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:56.890693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba49d2-3de4-4d45-a7b1-049866016576 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:56.890693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ba49d2-3de4-4d45-a7b1-049866016576 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:56.902960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 9/15] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:37:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:37:56.910976 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba49d2-3de4-4d45-a7b1-049866016576 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:57.008958 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 7/16] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:37:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 15:37:57.014597 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98786b9-5bac-4eb9-8ce5-4727d2ddbb6d None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:57.018693 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:57.026457 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ba49d2-3de4-4d45-a7b1-049866016576 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:57.063213 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7db58-67e0-42f3-81a2-1b9d19d232e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:57.064108 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7db58-67e0-42f3-81a2-1b9d19d232e9 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:57.064394 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7db58-67e0-42f3-81a2-1b9d19d232e9 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:57.064705 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb7db58-67e0-42f3-81a2-1b9d19d232e9 None admin] PATH_INFO: `/v3/users/c9c77caa8ec1422eb63723b3db112685` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:57.065954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7db58-67e0-42f3-81a2-1b9d19d232e9 None admin] RBAC: Authorizing `identity:get_user(user_id=c9c77caa8ec1422eb63723b3db112685)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:57.067431 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb7db58-67e0-42f3-81a2-1b9d19d232e9 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:57.069133 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 10/17] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:37:56 2022] GET /identity/v3/users/c9c77caa8ec1422eb63723b3db112685 => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:37:57.074896 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7db58-67e0-42f3-81a2-1b9d19d232e9 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:57.091114 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:57.148709 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98786b9-5bac-4eb9-8ce5-4727d2ddbb6d None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:57.187903 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb7db58-67e0-42f3-81a2-1b9d19d232e9 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:57.188610 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee7b9a-1ea4-40e5-b384-693be48370e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:57.189416 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee7b9a-1ea4-40e5-b384-693be48370e2 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:57.189697 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee7b9a-1ea4-40e5-b384-693be48370e2 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:57.189971 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee7b9a-1ea4-40e5-b384-693be48370e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:57.212357 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee7b9a-1ea4-40e5-b384-693be48370e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:57.214032 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee7b9a-1ea4-40e5-b384-693be48370e2 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:57.226600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70073c86-4b9e-40d5-ae1b-94eb70ef5151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:57.227440 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70073c86-4b9e-40d5-ae1b-94eb70ef5151 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:57.227729 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70073c86-4b9e-40d5-ae1b-94eb70ef5151 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:57.228007 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70073c86-4b9e-40d5-ae1b-94eb70ef5151 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:57.229267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70073c86-4b9e-40d5-ae1b-94eb70ef5151 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:57.230747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70073c86-4b9e-40d5-ae1b-94eb70ef5151 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:57.232370 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 11/18] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:37:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:37:57.239127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-cbee7b9a-1ea4-40e5-b384-693be48370e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:37:57.239127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:37:57.239127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:37:57.239127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:37:57.239127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:37:57.239127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:37:57.239127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:37:57.239127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:37:57.239127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:37:57.239127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:37:57.239127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:37:57.239127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:37:57.239127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:37:57.239127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:37:57.239127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:37:57.240341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:37:57.240341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:37:57.240341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:37:57.240341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:37:57.240341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:37:57.240341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:37:57.240341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:37:57.240341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:37:57.240341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:37:57.240341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:37:57.240341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:37:57.240341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:37:57.240341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:37:57.240341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:37:57.240341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:37:57.240341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:37:57.240341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:37:57.241650 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:37:57.241650 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:37:57.241650 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:37:57.241650 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:37:57.241932 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70073c86-4b9e-40d5-ae1b-94eb70ef5151 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:57.242012 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 8/19] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:37:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:37:57.247476 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee7b9a-1ea4-40e5-b384-693be48370e2 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:37:57.319894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:57.332210 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:37:57.352665 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70073c86-4b9e-40d5-ae1b-94eb70ef5151 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:57.373349 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee7b9a-1ea4-40e5-b384-693be48370e2 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:37:57.412972 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a57f1-09c7-4a6f-9563-d83615a61115 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:57.412972 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a57f1-09c7-4a6f-9563-d83615a61115 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:57.412972 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a57f1-09c7-4a6f-9563-d83615a61115 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:57.412972 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a57f1-09c7-4a6f-9563-d83615a61115 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:57.413358 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a57f1-09c7-4a6f-9563-d83615a61115 None admin] RBAC: Adding query filter params (role.id=ae72bfdddd1e4a94a21a0d53264ee157, scope.domain.id=default, user.id=c9c77caa8ec1422eb63723b3db112685) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:37:57.413358 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a57f1-09c7-4a6f-9563-d83615a61115 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:57.413358 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48a57f1-09c7-4a6f-9563-d83615a61115 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:57.413358 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 12/20] 10.222.0.62 () {56 vars in 1322 bytes} [Wed May 25 15:37:57 2022] GET /identity/v3/role_assignments?user.id=c9c77caa8ec1422eb63723b3db112685&scope.domain.id=default&role.id=ae72bfdddd1e4a94a21a0d53264ee157 => generated 233 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:37:57.414577 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277ac6b3-284d-45ac-9301-19dea0bbe900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:37:57.415273 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ac6b3-284d-45ac-9301-19dea0bbe900 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:37:57.415558 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ac6b3-284d-45ac-9301-19dea0bbe900 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:37:57.415836 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277ac6b3-284d-45ac-9301-19dea0bbe900 None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:37:57.416646 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ac6b3-284d-45ac-9301-19dea0bbe900 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:37:57.417238 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ac6b3-284d-45ac-9301-19dea0bbe900 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:37:57.418461 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277ac6b3-284d-45ac-9301-19dea0bbe900 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:37:57.441574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 9/21] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:00.348512 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15685d01-db22-4c90-848b-17f1917236cb None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:00.349551 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15685d01-db22-4c90-848b-17f1917236cb None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:00.350071 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15685d01-db22-4c90-848b-17f1917236cb None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:00.351668 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 13/22] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:00.357705 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e55e1-5392-4f36-961a-10f298ee512d None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:00.358617 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e55e1-5392-4f36-961a-10f298ee512d None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:00.359635 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284e55e1-5392-4f36-961a-10f298ee512d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:00.389746 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-284e55e1-5392-4f36-961a-10f298ee512d None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:00.392055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-284e55e1-5392-4f36-961a-10f298ee512d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:00.485383 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 10/23] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:00.527492 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15685d01-db22-4c90-848b-17f1917236cb None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:00.663078 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15685d01-db22-4c90-848b-17f1917236cb None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:00.712594 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9788db6-ce8d-459e-8607-fc260fa8194e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:00.713433 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9788db6-ce8d-459e-8607-fc260fa8194e None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:00.713730 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9788db6-ce8d-459e-8607-fc260fa8194e None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:00.714016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9788db6-ce8d-459e-8607-fc260fa8194e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:00.732742 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9788db6-ce8d-459e-8607-fc260fa8194e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:00.742167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-b9788db6-ce8d-459e-8607-fc260fa8194e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:38:00.742167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:00.742167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:00.742167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:00.742167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:00.742167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:00.742167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:00.742167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:00.742167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:00.742167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:00.742167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:00.742167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:00.742167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:00.742167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:00.742167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:00.742167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:00.743100 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:00.743100 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:00.743100 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:00.743100 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:00.743100 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:00.743100 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:00.743100 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:00.743100 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:00.743100 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:00.743100 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:00.743100 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:00.743100 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:00.743100 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:00.743100 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:00.743100 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:00.743100 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:00.743848 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:00.743848 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:00.743848 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:00.743848 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:00.743848 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:00.743848 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:00.743848 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:00.743848 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:00.743848 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:00.743848 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:00.743848 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:38:00.743848 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:00.747560 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 14/24] 10.222.0.62 () {56 vars in 1096 bytes} [Wed May 25 15:38:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:00.754228 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e55e1-5392-4f36-961a-10f298ee512d None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:00.832331 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dc1e6-7c3a-4d42-af57-ce1afc93a661 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:00.833339 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dc1e6-7c3a-4d42-af57-ce1afc93a661 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:00.835092 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9dc1e6-7c3a-4d42-af57-ce1afc93a661 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:00.840397 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 15/25] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:00.848662 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa935d5-f65a-4725-984c-d87406182416 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:00.849992 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa935d5-f65a-4725-984c-d87406182416 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:00.850749 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa935d5-f65a-4725-984c-d87406182416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:00.855922 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:00.868705 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:00.896046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-eaa935d5-f65a-4725-984c-d87406182416 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:00.897383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-eaa935d5-f65a-4725-984c-d87406182416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:00.965266 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284e55e1-5392-4f36-961a-10f298ee512d None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:01.050154 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec25ff-956a-4bb8-9980-570ef162566c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:01.050851 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec25ff-956a-4bb8-9980-570ef162566c None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:01.051171 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec25ff-956a-4bb8-9980-570ef162566c None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:01.051550 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec25ff-956a-4bb8-9980-570ef162566c None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:01.052528 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec25ff-956a-4bb8-9980-570ef162566c None admin] RBAC: Adding query filter params (name=admin) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:01.052965 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec25ff-956a-4bb8-9980-570ef162566c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:01.054508 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec25ff-956a-4bb8-9980-570ef162566c None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:01.084090 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 16/26] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:01.088967 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 11/27] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:01.092679 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb78a5-5122-44ab-95c8-36b17826ee9d None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:01.092679 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb78a5-5122-44ab-95c8-36b17826ee9d None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:01.092679 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcb78a5-5122-44ab-95c8-36b17826ee9d None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:01.096842 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 17/28] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:01.102145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec25ff-956a-4bb8-9980-570ef162566c None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:01.102454 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfb18a-0ad7-4082-80de-ce788513d4d6 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:01.102454 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfb18a-0ad7-4082-80de-ce788513d4d6 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:01.102696 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cfb18a-0ad7-4082-80de-ce788513d4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:01.132454 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-30cfb18a-0ad7-4082-80de-ce788513d4d6 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:01.132454 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-30cfb18a-0ad7-4082-80de-ce788513d4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:01.320521 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec25ff-956a-4bb8-9980-570ef162566c None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:01.352791 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:01.386299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 18/29] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:38:01.387243 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfb18a-0ad7-4082-80de-ce788513d4d6 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:01.409789 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a74bb-3506-45d4-87a5-96542d6c0e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:01.412132 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a74bb-3506-45d4-87a5-96542d6c0e3b None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:01.412709 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a74bb-3506-45d4-87a5-96542d6c0e3b None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:01.413190 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528a74bb-3506-45d4-87a5-96542d6c0e3b None admin] PATH_INFO: `/v3/users/c9c77caa8ec1422eb63723b3db112685` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:01.415273 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a74bb-3506-45d4-87a5-96542d6c0e3b None admin] RBAC: Authorizing `identity:get_user(user_id=c9c77caa8ec1422eb63723b3db112685)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:01.416977 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528a74bb-3506-45d4-87a5-96542d6c0e3b None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:01.425342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 12/30] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:01 2022] GET /identity/v3/users/c9c77caa8ec1422eb63723b3db112685 => generated 247 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:01.436143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a74bb-3506-45d4-87a5-96542d6c0e3b None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:01.553389 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:01.623356 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cfb18a-0ad7-4082-80de-ce788513d4d6 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:01.664018 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c4484-920a-4e0e-aac8-3b27457318e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:01.665452 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c4484-920a-4e0e-aac8-3b27457318e4 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:01.666090 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c4484-920a-4e0e-aac8-3b27457318e4 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:01.666514 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73c4484-920a-4e0e-aac8-3b27457318e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:01.681502 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c4484-920a-4e0e-aac8-3b27457318e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:01.683384 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73c4484-920a-4e0e-aac8-3b27457318e4 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:01.699658 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528a74bb-3506-45d4-87a5-96542d6c0e3b None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:01.707865 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-e73c4484-920a-4e0e-aac8-3b27457318e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:38:01.707865 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:01.707865 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:01.707865 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:01.707865 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:01.707865 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:01.707865 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:01.707865 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:01.707865 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:01.707865 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:01.707865 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:01.707865 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:01.707865 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:38:01.707865 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:38:01.707865 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:38:01.708801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:38:01.708801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:01.708801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:01.708801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:01.708801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:01.708801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:01.708801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:01.708801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:01.708801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:01.708801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:01.708801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:01.708801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:01.708801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:01.708801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:01.708801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:01.708801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:01.708801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:01.709681 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:38:01.709681 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:38:01.709681 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:38:01.709681 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:01.712940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 19/31] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:38:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:01.714708 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c4484-920a-4e0e-aac8-3b27457318e4 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:01.782792 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f92287-496b-4a5d-892f-790010075306 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:01.784201 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f92287-496b-4a5d-892f-790010075306 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:01.785052 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f92287-496b-4a5d-892f-790010075306 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:01.785800 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f92287-496b-4a5d-892f-790010075306 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:01.788405 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f92287-496b-4a5d-892f-790010075306 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:01.791892 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f92287-496b-4a5d-892f-790010075306 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:01.803786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 13/32] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:38:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:01.809285 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06df6fc-a2a8-48bf-b163-fb7828549082 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:01.809285 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06df6fc-a2a8-48bf-b163-fb7828549082 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:01.809285 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06df6fc-a2a8-48bf-b163-fb7828549082 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:01.813408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 14/33] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:01.815232 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06df6fc-a2a8-48bf-b163-fb7828549082 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:01.845696 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73c4484-920a-4e0e-aac8-3b27457318e4 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:01.865216 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:01.885252 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385115c-0fcc-4ce1-b85a-8865e9e2a1e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:01.886002 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385115c-0fcc-4ce1-b85a-8865e9e2a1e0 None admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:01.886411 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385115c-0fcc-4ce1-b85a-8865e9e2a1e0 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:01.886922 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385115c-0fcc-4ce1-b85a-8865e9e2a1e0 None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:01.887650 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385115c-0fcc-4ce1-b85a-8865e9e2a1e0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:01.889317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385115c-0fcc-4ce1-b85a-8865e9e2a1e0 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:01.928118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:02.005605 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06df6fc-a2a8-48bf-b163-fb7828549082 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:02.053431 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb99f1-dc9b-43c0-a737-b33ac561611e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:02.055984 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb99f1-dc9b-43c0-a737-b33ac561611e None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:02.056665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb99f1-dc9b-43c0-a737-b33ac561611e None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:02.057154 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb99f1-dc9b-43c0-a737-b33ac561611e None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:02.058672 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb99f1-dc9b-43c0-a737-b33ac561611e None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:02.059266 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb99f1-dc9b-43c0-a737-b33ac561611e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:02.062858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb99f1-dc9b-43c0-a737-b33ac561611e None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:02.085186 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 15/34] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:02.087187 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afc096-3efb-416f-8b8d-06792260b446 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:02.087777 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afc096-3efb-416f-8b8d-06792260b446 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:02.088225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70afc096-3efb-416f-8b8d-06792260b446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:02.111936 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-70afc096-3efb-416f-8b8d-06792260b446 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:02.113635 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-70afc096-3efb-416f-8b8d-06792260b446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:02.154745 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 20/35] 10.222.0.62 () {60 vars in 1131 bytes} [Wed May 25 15:38:01 2022] POST /identity/v3/roles => generated 219 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:38:02.156969 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385115c-0fcc-4ce1-b85a-8865e9e2a1e0 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:02.221396 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 16/36] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:02.222647 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afc096-3efb-416f-8b8d-06792260b446 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:02.276484 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:02.344588 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385115c-0fcc-4ce1-b85a-8865e9e2a1e0 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:02.377594 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70afc096-3efb-416f-8b8d-06792260b446 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:02.407185 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d002335-00a8-4048-89bb-ec34662199c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:02.408818 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d002335-00a8-4048-89bb-ec34662199c3 None admin] REQUEST_METHOD: `PUT` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:02.409254 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d002335-00a8-4048-89bb-ec34662199c3 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:02.409673 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d002335-00a8-4048-89bb-ec34662199c3 None admin] PATH_INFO: `/v3/domains/default/users/c9c77caa8ec1422eb63723b3db112685/roles/ae72bfdddd1e4a94a21a0d53264ee157` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:02.414784 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d002335-00a8-4048-89bb-ec34662199c3 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c9c77caa8ec1422eb63723b3db112685, role_id=ae72bfdddd1e4a94a21a0d53264ee157)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:02.417016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d002335-00a8-4048-89bb-ec34662199c3 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:02.432630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0d380c-2d90-4b6b-9584-4ad0563d5d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:02.433348 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d380c-2d90-4b6b-9584-4ad0563d5d1a None admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:02.433640 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d380c-2d90-4b6b-9584-4ad0563d5d1a None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:02.433956 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0d380c-2d90-4b6b-9584-4ad0563d5d1a None admin] PATH_INFO: `/v3/projects` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:02.448658 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d380c-2d90-4b6b-9584-4ad0563d5d1a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:02.448658 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0d380c-2d90-4b6b-9584-4ad0563d5d1a None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:02.524147 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 21/37] 10.222.0.62 () {58 vars in 1361 bytes} [Wed May 25 15:38:02 2022] PUT /identity/v3/domains/default/users/c9c77caa8ec1422eb63723b3db112685/roles/ae72bfdddd1e4a94a21a0d53264ee157 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:38:02.525035 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d002335-00a8-4048-89bb-ec34662199c3 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:02.572887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:02.661875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d002335-00a8-4048-89bb-ec34662199c3 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:02.710519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd29f79-9b34-4845-ad8c-80d21a7891bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:02.711258 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd29f79-9b34-4845-ad8c-80d21a7891bd None admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:02.711548 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd29f79-9b34-4845-ad8c-80d21a7891bd None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:02.711852 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd29f79-9b34-4845-ad8c-80d21a7891bd None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:02.712691 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd29f79-9b34-4845-ad8c-80d21a7891bd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:02.714408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd29f79-9b34-4845-ad8c-80d21a7891bd None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:02.728839 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 17/38] 10.222.0.62 () {60 vars in 1141 bytes} [Wed May 25 15:38:02 2022] POST /identity/v3/projects => generated 301 bytes in 507 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:38:02.730681 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132047e8-6190-40fa-9783-1bbeeeb9957f None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:02.730984 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132047e8-6190-40fa-9783-1bbeeeb9957f None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:02.731270 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132047e8-6190-40fa-9783-1bbeeeb9957f None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:02.745035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 18/39] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:02.745035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4630c6e-9c3f-4d48-8588-0c797e08d159 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:02.745035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4630c6e-9c3f-4d48-8588-0c797e08d159 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:02.745035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4630c6e-9c3f-4d48-8588-0c797e08d159 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:02.745035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 19/40] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:02.746799 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9414c-7230-4594-aacf-a2176ddae717 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:02.746799 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9414c-7230-4594-aacf-a2176ddae717 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:02.746799 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9414c-7230-4594-aacf-a2176ddae717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:02.772247 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-eaa9414c-7230-4594-aacf-a2176ddae717 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:02.774134 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-eaa9414c-7230-4594-aacf-a2176ddae717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:02.832219 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 22/41] 10.222.0.62 () {60 vars in 1131 bytes} [Wed May 25 15:38:02 2022] POST /identity/v3/roles => generated 225 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:38:02.840453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e03edc-b003-4ffc-8962-5f6bc1029a2b None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:02.841731 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e03edc-b003-4ffc-8962-5f6bc1029a2b None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:02.842590 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e03edc-b003-4ffc-8962-5f6bc1029a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:02.882306 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 20/42] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:02.891007 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-51e03edc-b003-4ffc-8962-5f6bc1029a2b None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:02.894440 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-51e03edc-b003-4ffc-8962-5f6bc1029a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:02.926646 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9414c-7230-4594-aacf-a2176ddae717 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:02.981191 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:03.034587 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 23/43] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:03.064335 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e03edc-b003-4ffc-8962-5f6bc1029a2b None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:03.099239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:03.100386 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9414c-7230-4594-aacf-a2176ddae717 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:03.156905 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9bd74-bf66-4e00-a50e-aaca04d93626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:03.157696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9bd74-bf66-4e00-a50e-aaca04d93626 None admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:03.157990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9bd74-bf66-4e00-a50e-aaca04d93626 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:03.158279 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9bd74-bf66-4e00-a50e-aaca04d93626 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:03.159281 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9bd74-bf66-4e00-a50e-aaca04d93626 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:03.161015 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9bd74-bf66-4e00-a50e-aaca04d93626 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:03.192399 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e03edc-b003-4ffc-8962-5f6bc1029a2b None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:03.238350 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485bf86-5e11-4446-9147-372461fa451e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:03.239156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485bf86-5e11-4446-9147-372461fa451e None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:03.239435 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485bf86-5e11-4446-9147-372461fa451e None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:03.239707 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485bf86-5e11-4446-9147-372461fa451e None admin] PATH_INFO: `/v3/domains/default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:03.240923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485bf86-5e11-4446-9147-372461fa451e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:03.242439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485bf86-5e11-4446-9147-372461fa451e None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:03.244230 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 24/44] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:38:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:03.250155 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485bf86-5e11-4446-9147-372461fa451e None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:03.272445 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 21/45] 10.222.0.62 () {60 vars in 1131 bytes} [Wed May 25 15:38:02 2022] POST /identity/v3/roles => generated 223 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:38:03.379475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:03.387179 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485bf86-5e11-4446-9147-372461fa451e None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:03.436657 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7934d3-d311-4321-a888-7d8454353310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:03.437878 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7934d3-d311-4321-a888-7d8454353310 None admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:03.438196 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7934d3-d311-4321-a888-7d8454353310 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:03.438479 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7934d3-d311-4321-a888-7d8454353310 None admin] PATH_INFO: `/v3/projects` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:03.439358 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7934d3-d311-4321-a888-7d8454353310 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:03.440914 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7934d3-d311-4321-a888-7d8454353310 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:03.544478 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 25/46] 10.222.0.62 () {60 vars in 1141 bytes} [Wed May 25 15:38:03 2022] POST /identity/v3/projects => generated 312 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:38:04.998856 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bb7e7-03d3-417e-a70f-064b1f029acd None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:04.999411 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bb7e7-03d3-417e-a70f-064b1f029acd None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:04.999497 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035bb7e7-03d3-417e-a70f-064b1f029acd None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:05.000906 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 22/47] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:05.006426 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4269d-2923-4986-9a25-a981775d7e67 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:05.006855 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4269d-2923-4986-9a25-a981775d7e67 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:05.007122 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4269d-2923-4986-9a25-a981775d7e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:05.024677 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-f7e4269d-2923-4986-9a25-a981775d7e67 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:05.025888 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-f7e4269d-2923-4986-9a25-a981775d7e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:05.096766 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 26/48] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:05.121417 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bb7e7-03d3-417e-a70f-064b1f029acd None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:05.209638 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:05.233581 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035bb7e7-03d3-417e-a70f-064b1f029acd None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:05.268743 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74129a8-af2a-4771-8bb6-d14c1df694a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:05.269725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74129a8-af2a-4771-8bb6-d14c1df694a2 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:05.270010 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74129a8-af2a-4771-8bb6-d14c1df694a2 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:05.270291 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74129a8-af2a-4771-8bb6-d14c1df694a2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:05.283406 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74129a8-af2a-4771-8bb6-d14c1df694a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:05.292451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-b74129a8-af2a-4771-8bb6-d14c1df694a2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:38:05.292451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:05.292451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:05.292451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:05.292451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:05.292451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:05.292451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:05.292451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:05.292451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:05.292451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:05.292451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:05.292451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:05.292451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:05.292451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:05.292451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:05.292451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:05.293399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:05.293399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:05.293399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:05.293399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:05.293399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:05.293399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:05.293399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:05.293399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:05.293399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:05.293399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:05.293399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:05.293399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:38:05.293399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:05.293399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:05.293399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:05.293399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:05.294157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:05.294157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:05.294157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:05.294157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:05.294157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:05.294157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:05.294157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:05.294157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:05.294157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:05.294157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:05.294157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:38:05.294157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:38:05.294157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 23/49] 10.222.0.62 () {56 vars in 1096 bytes} [Wed May 25 15:38:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:05.299974 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4269d-2923-4986-9a25-a981775d7e67 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:05.379977 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:05.407451 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4269d-2923-4986-9a25-a981775d7e67 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:05.445578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322a240-b245-4801-a371-d625467bae4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:05.446253 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322a240-b245-4801-a371-d625467bae4e None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:05.446540 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322a240-b245-4801-a371-d625467bae4e None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:05.446817 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1322a240-b245-4801-a371-d625467bae4e None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:05.447596 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322a240-b245-4801-a371-d625467bae4e None admin] RBAC: Adding query filter params (name=admin) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:05.447902 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322a240-b245-4801-a371-d625467bae4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:05.449327 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1322a240-b245-4801-a371-d625467bae4e None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:05.459312 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 27/50] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:05.465014 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74129a8-af2a-4771-8bb6-d14c1df694a2 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:05.575686 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74129a8-af2a-4771-8bb6-d14c1df694a2 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:05.620622 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e9cef-c658-413e-8f65-e57ca7045866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:05.621506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e9cef-c658-413e-8f65-e57ca7045866 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:05.621788 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e9cef-c658-413e-8f65-e57ca7045866 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:05.622069 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8e9cef-c658-413e-8f65-e57ca7045866 None admin] PATH_INFO: `/v3/users/c9c77caa8ec1422eb63723b3db112685` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:05.623273 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e9cef-c658-413e-8f65-e57ca7045866 None admin] RBAC: Authorizing `identity:get_user(user_id=c9c77caa8ec1422eb63723b3db112685)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:05.625419 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8e9cef-c658-413e-8f65-e57ca7045866 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:05.627044 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 24/51] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:05 2022] GET /identity/v3/users/c9c77caa8ec1422eb63723b3db112685 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:05.632640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322a240-b245-4801-a371-d625467bae4e None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:05.741277 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1322a240-b245-4801-a371-d625467bae4e None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:05.783631 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e3b2f-ebe9-40c0-81c1-061319132237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:05.784482 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e3b2f-ebe9-40c0-81c1-061319132237 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:05.784774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e3b2f-ebe9-40c0-81c1-061319132237 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:05.785057 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e3b2f-ebe9-40c0-81c1-061319132237 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:05.786263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e3b2f-ebe9-40c0-81c1-061319132237 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:05.788644 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00e3b2f-ebe9-40c0-81c1-061319132237 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:05.790280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 28/52] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:38:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:05.797444 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e9cef-c658-413e-8f65-e57ca7045866 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:05.802764 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:05.874286 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b59a60-607f-4acb-a9c5-284f91b11a96 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:05.875207 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b59a60-607f-4acb-a9c5-284f91b11a96 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:05.875802 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b59a60-607f-4acb-a9c5-284f91b11a96 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:05.877260 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 29/53] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:38:05.882345 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0285ff-8b08-4612-a9df-7da4fd982139 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:05.882632 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0285ff-8b08-4612-a9df-7da4fd982139 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:05.882924 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0285ff-8b08-4612-a9df-7da4fd982139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:05.895673 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:05.901247 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-8d0285ff-8b08-4612-a9df-7da4fd982139 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:05.902588 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-8d0285ff-8b08-4612-a9df-7da4fd982139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:05.904784 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8e9cef-c658-413e-8f65-e57ca7045866 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:05.941058 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d4354-4775-4502-9733-cc2bd781b602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:05.941757 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d4354-4775-4502-9733-cc2bd781b602 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:05.942074 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d4354-4775-4502-9733-cc2bd781b602 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:05.942339 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9d4354-4775-4502-9733-cc2bd781b602 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:05.943168 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d4354-4775-4502-9733-cc2bd781b602 None admin] RBAC: Adding query filter params (role.id=ae72bfdddd1e4a94a21a0d53264ee157, scope.domain.id=default, user.id=c9c77caa8ec1422eb63723b3db112685) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:05.943481 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d4354-4775-4502-9733-cc2bd781b602 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:05.944972 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9d4354-4775-4502-9733-cc2bd781b602 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:05.954361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 25/54] 10.222.0.62 () {56 vars in 1322 bytes} [Wed May 25 15:38:05 2022] GET /identity/v3/role_assignments?user.id=c9c77caa8ec1422eb63723b3db112685&scope.domain.id=default&role.id=ae72bfdddd1e4a94a21a0d53264ee157 => generated 530 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:05.977434 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 30/55] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:38:06.004809 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d4354-4775-4502-9733-cc2bd781b602 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:06.079247 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:06.116286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9d4354-4775-4502-9733-cc2bd781b602 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:06.159158 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd8c692-31be-4386-8912-d9f3109053e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:06.160035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8c692-31be-4386-8912-d9f3109053e9 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:06.160318 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8c692-31be-4386-8912-d9f3109053e9 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:06.160640 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd8c692-31be-4386-8912-d9f3109053e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:06.161836 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8c692-31be-4386-8912-d9f3109053e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:06.163300 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd8c692-31be-4386-8912-d9f3109053e9 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:06.164989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 26/56] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:38:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:06.171013 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0285ff-8b08-4612-a9df-7da4fd982139 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:06.277282 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0285ff-8b08-4612-a9df-7da4fd982139 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:06.310532 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee4839d-55be-4f7c-8261-f0a29fff8e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:06.311198 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4839d-55be-4f7c-8261-f0a29fff8e0c None admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:06.311489 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4839d-55be-4f7c-8261-f0a29fff8e0c None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:06.311770 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee4839d-55be-4f7c-8261-f0a29fff8e0c None admin] PATH_INFO: `/v3/projects` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:06.314050 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4839d-55be-4f7c-8261-f0a29fff8e0c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:06.314553 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee4839d-55be-4f7c-8261-f0a29fff8e0c None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:06.318910 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:06.409920 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 31/57] 10.222.0.62 () {60 vars in 1140 bytes} [Wed May 25 15:38:06 2022] POST /identity/v3/projects => generated 298 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:38:08.718420 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120735c9-b9fd-40e0-ad3f-c650d6ee56bf None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:08.718948 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120735c9-b9fd-40e0-ad3f-c650d6ee56bf None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:08.719034 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120735c9-b9fd-40e0-ad3f-c650d6ee56bf None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:08.720488 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 27/58] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:08.725914 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510d46f-3628-46da-aaf1-43b60dec1be2 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:08.726303 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510d46f-3628-46da-aaf1-43b60dec1be2 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:08.726479 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5510d46f-3628-46da-aaf1-43b60dec1be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:08.743990 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-5510d46f-3628-46da-aaf1-43b60dec1be2 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:08.745227 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-5510d46f-3628-46da-aaf1-43b60dec1be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:08.811499 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 32/59] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:08.838268 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120735c9-b9fd-40e0-ad3f-c650d6ee56bf None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:08.945802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120735c9-b9fd-40e0-ad3f-c650d6ee56bf None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:08.980477 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22c4f2c-1929-46a5-82eb-f24788222b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:08.981212 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c4f2c-1929-46a5-82eb-f24788222b67 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:08.981502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c4f2c-1929-46a5-82eb-f24788222b67 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:08.981784 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22c4f2c-1929-46a5-82eb-f24788222b67 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:08.982962 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c4f2c-1929-46a5-82eb-f24788222b67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:08.984748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22c4f2c-1929-46a5-82eb-f24788222b67 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:08.986381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 28/60] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:38:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:08.991922 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510d46f-3628-46da-aaf1-43b60dec1be2 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:09.092945 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5510d46f-3628-46da-aaf1-43b60dec1be2 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:09.111299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:09.128821 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91668039-f304-45fe-b6e8-e88e89acf5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:09.129519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91668039-f304-45fe-b6e8-e88e89acf5a8 None admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:09.129802 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91668039-f304-45fe-b6e8-e88e89acf5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:09.130967 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91668039-f304-45fe-b6e8-e88e89acf5a8 None admin] PATH_INFO: `/v3/users` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:09.130967 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91668039-f304-45fe-b6e8-e88e89acf5a8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:09.132491 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91668039-f304-45fe-b6e8-e88e89acf5a8 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:09.245983 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 33/61] 10.222.0.62 () {60 vars in 1132 bytes} [Wed May 25 15:38:08 2022] POST /identity/v3/users => generated 275 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:38:13.157613 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61adbc-8de1-43cb-9e36-ae451c645207 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:13.159305 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61adbc-8de1-43cb-9e36-ae451c645207 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:13.160082 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61adbc-8de1-43cb-9e36-ae451c645207 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:13.162976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 29/62] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:13.168708 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8572b2-ac4c-418a-bf9e-ce0052b65392 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:13.169437 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8572b2-ac4c-418a-bf9e-ce0052b65392 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:13.169437 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8572b2-ac4c-418a-bf9e-ce0052b65392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:13.198132 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-1d8572b2-ac4c-418a-bf9e-ce0052b65392 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:13.200739 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-1d8572b2-ac4c-418a-bf9e-ce0052b65392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:13.266942 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c633b-0f15-464e-8b2a-c01498df1e3a None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:13.267228 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c633b-0f15-464e-8b2a-c01498df1e3a None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:13.267733 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8c633b-0f15-464e-8b2a-c01498df1e3a None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:13.269599 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 30/63] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:38:13.277677 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda79da7-1452-4d84-b523-0a6db39cbb3e None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:13.278219 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda79da7-1452-4d84-b523-0a6db39cbb3e None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:13.278691 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda79da7-1452-4d84-b523-0a6db39cbb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:13.287287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:13.305422 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-bda79da7-1452-4d84-b523-0a6db39cbb3e None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:13.306866 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-bda79da7-1452-4d84-b523-0a6db39cbb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:13.351069 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 34/64] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:13.390743 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8572b2-ac4c-418a-bf9e-ce0052b65392 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:13.448383 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 31/65] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:38:13.450854 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1e96b-6e09-4fb5-a7cb-e7498dfab10b None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:13.451365 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1e96b-6e09-4fb5-a7cb-e7498dfab10b None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:13.451827 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1e96b-6e09-4fb5-a7cb-e7498dfab10b None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:13.454115 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 32/66] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:13.459811 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b07e3-41a8-4c23-a6ad-efc798a1ea11 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:13.464791 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b07e3-41a8-4c23-a6ad-efc798a1ea11 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:13.465322 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b07e3-41a8-4c23-a6ad-efc798a1ea11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:13.489759 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-912b07e3-41a8-4c23-a6ad-efc798a1ea11 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:13.491415 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-912b07e3-41a8-4c23-a6ad-efc798a1ea11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:13.550636 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8572b2-ac4c-418a-bf9e-ce0052b65392 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:13.555363 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:13.586164 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 33/67] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:13.587521 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b07e3-41a8-4c23-a6ad-efc798a1ea11 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:13.598497 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb02772a-cb34-4231-884b-10012e6f0316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:13.599543 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02772a-cb34-4231-884b-10012e6f0316 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:13.600532 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02772a-cb34-4231-884b-10012e6f0316 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:13.600987 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb02772a-cb34-4231-884b-10012e6f0316 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:13.618667 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb02772a-cb34-4231-884b-10012e6f0316 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:13.627174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-eb02772a-cb34-4231-884b-10012e6f0316 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:13.627174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:13.627174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:13.627174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:13.627174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:13.627174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:13.627174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:13.627174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:13.627174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:13.627174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:13.627174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:13.627174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:13.627174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:13.627174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:13.627174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:13.627174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:13.628269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:13.628269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:13.628269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:13.628269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:13.628269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:13.628269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:13.628269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:13.628269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:13.628269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:13.628269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:13.628269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:13.628269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:13.628269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:13.628269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:13.628269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:13.628269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:13.629290 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:13.629290 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:13.629290 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:13.629290 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:13.629290 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:13.629290 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:13.629290 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:13.629290 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:13.629290 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:13.629290 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:13.629290 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:13.629290 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:13.629290 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 35/68] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:38:13.630092 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aa198-7bff-4aff-9d77-db701a0394f9 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:13.630092 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aa198-7bff-4aff-9d77-db701a0394f9 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:13.630245 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479aa198-7bff-4aff-9d77-db701a0394f9 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:13.636582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 36/69] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:13.636582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479aa198-7bff-4aff-9d77-db701a0394f9 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:13.660338 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:13.700634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b07e3-41a8-4c23-a6ad-efc798a1ea11 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:13.741630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a7a8e2-b7ee-49b6-8973-49402ee05280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:13.742584 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7a8e2-b7ee-49b6-8973-49402ee05280 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:13.742876 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7a8e2-b7ee-49b6-8973-49402ee05280 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:13.743190 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a7a8e2-b7ee-49b6-8973-49402ee05280 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:13.745115 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479aa198-7bff-4aff-9d77-db701a0394f9 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:13.756526 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a7a8e2-b7ee-49b6-8973-49402ee05280 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:13.764989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-48a7a8e2-b7ee-49b6-8973-49402ee05280 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:38:13.764989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:13.764989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:13.764989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:13.764989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:13.764989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:13.764989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:13.764989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:13.764989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:13.764989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:13.764989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:13.764989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:13.764989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:13.764989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:13.764989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:13.764989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:13.766715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:13.766715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:13.766715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:13.766715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:13.766715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:13.766715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:13.766715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:13.766715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:13.766715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:13.766715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:13.766715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:13.766715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:38:13.766715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:13.766715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:13.766715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:13.766715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:13.767538 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:13.767538 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:13.767538 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:13.767538 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:13.767538 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:13.767538 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:13.767538 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:13.767538 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:13.767538 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:13.767538 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:13.767538 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:38:13.767538 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:38:13.767538 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 34/70] 10.222.0.62 () {56 vars in 1114 bytes} [Wed May 25 15:38:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:13.768182 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308932c5-ec6d-4ae5-8a52-05cdc34a2536 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:13.768182 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308932c5-ec6d-4ae5-8a52-05cdc34a2536 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:13.768310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308932c5-ec6d-4ae5-8a52-05cdc34a2536 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:13.772538 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 35/71] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:13.772538 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308932c5-ec6d-4ae5-8a52-05cdc34a2536 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:13.790188 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b044fec7-a496-4210-957f-856801dc61cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:13.791012 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044fec7-a496-4210-957f-856801dc61cc None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:13.791298 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044fec7-a496-4210-957f-856801dc61cc None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:13.791578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b044fec7-a496-4210-957f-856801dc61cc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:13.810245 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b044fec7-a496-4210-957f-856801dc61cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:13.818331 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-b044fec7-a496-4210-957f-856801dc61cc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:38:13.818331 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:13.818331 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:13.818331 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:13.818331 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:13.818331 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:13.818331 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:13.818331 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:13.818331 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:13.818331 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:13.818331 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:13.818331 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:13.818331 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:13.818331 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:13.818331 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:13.818331 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:13.819475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:13.819475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:13.819475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:13.819475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:13.819475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:13.819475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:13.819475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:13.819475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:13.819475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:13.819475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:13.819475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:13.819475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:13.819475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:13.819475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:13.819475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:13.819475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:13.820259 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:13.820259 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:13.820259 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:13.820259 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:13.820259 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:13.820259 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:13.820259 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:13.820259 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:13.820259 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:13.820259 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:13.820259 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:38:13.820259 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:13.820259 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 37/72] 10.222.0.62 () {56 vars in 1096 bytes} [Wed May 25 15:38:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:13.820915 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641602a7-049a-477c-adda-03e6531a3751 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:13.821196 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641602a7-049a-477c-adda-03e6531a3751 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:13.821381 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641602a7-049a-477c-adda-03e6531a3751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:13.838341 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-641602a7-049a-477c-adda-03e6531a3751 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:13.839572 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-641602a7-049a-477c-adda-03e6531a3751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:13.859536 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:13.899535 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308932c5-ec6d-4ae5-8a52-05cdc34a2536 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:13.912249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 38/73] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:13.913080 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641602a7-049a-477c-adda-03e6531a3751 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:13.928548 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:13.939973 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c97f16-8d1e-4e5f-be40-d33a497a0c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:13.940980 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c97f16-8d1e-4e5f-be40-d33a497a0c6e None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:13.941101 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c97f16-8d1e-4e5f-be40-d33a497a0c6e None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:13.941367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c97f16-8d1e-4e5f-be40-d33a497a0c6e None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:13.942125 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c97f16-8d1e-4e5f-be40-d33a497a0c6e None admin] RBAC: Adding query filter params (name=member) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:13.942436 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c97f16-8d1e-4e5f-be40-d33a497a0c6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:13.943840 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c97f16-8d1e-4e5f-be40-d33a497a0c6e None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:13.957701 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 36/74] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:13.957701 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5d185-a67e-4b81-b6a3-22da2afe7f0b None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:13.957701 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5d185-a67e-4b81-b6a3-22da2afe7f0b None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:13.957701 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c5d185-a67e-4b81-b6a3-22da2afe7f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:13.974720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-f9c5d185-a67e-4b81-b6a3-22da2afe7f0b None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:13.976024 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-f9c5d185-a67e-4b81-b6a3-22da2afe7f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:14.027428 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641602a7-049a-477c-adda-03e6531a3751 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:14.048908 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 37/75] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:14.050151 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5d185-a67e-4b81-b6a3-22da2afe7f0b None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:14.066482 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f674e82-da69-4c21-add4-ff4d24eb4926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:14.067165 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f674e82-da69-4c21-add4-ff4d24eb4926 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:14.067526 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f674e82-da69-4c21-add4-ff4d24eb4926 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:14.067735 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f674e82-da69-4c21-add4-ff4d24eb4926 None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:14.068534 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f674e82-da69-4c21-add4-ff4d24eb4926 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:14.069036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f674e82-da69-4c21-add4-ff4d24eb4926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:14.070288 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f674e82-da69-4c21-add4-ff4d24eb4926 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:14.082054 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 39/76] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:38:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:14.083617 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f674e82-da69-4c21-add4-ff4d24eb4926 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:14.103582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:14.158147 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c5d185-a67e-4b81-b6a3-22da2afe7f0b None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:14.177027 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:14.192423 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f674e82-da69-4c21-add4-ff4d24eb4926 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:14.195551 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145542b-b4e0-4dfc-b764-ad096e940aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:14.196227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145542b-b4e0-4dfc-b764-ad096e940aa4 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:14.196545 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145542b-b4e0-4dfc-b764-ad096e940aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:14.196830 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145542b-b4e0-4dfc-b764-ad096e940aa4 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:14.197579 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145542b-b4e0-4dfc-b764-ad096e940aa4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:14.197891 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145542b-b4e0-4dfc-b764-ad096e940aa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:14.199275 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9145542b-b4e0-4dfc-b764-ad096e940aa4 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:14.208212 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 38/77] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:14.208993 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145542b-b4e0-4dfc-b764-ad096e940aa4 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:14.234682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e22b8-04f9-4c9d-b427-7de7abb57e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:14.235497 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e22b8-04f9-4c9d-b427-7de7abb57e19 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:14.235815 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e22b8-04f9-4c9d-b427-7de7abb57e19 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:14.236046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e22b8-04f9-4c9d-b427-7de7abb57e19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:14.246499 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e22b8-04f9-4c9d-b427-7de7abb57e19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:14.254748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-497e22b8-04f9-4c9d-b427-7de7abb57e19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:14.254748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:14.254748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:14.254748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:14.254748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:14.254748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:14.254748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:14.254748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:14.254748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:14.254748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:14.254748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:14.254748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:14.254748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:14.254748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:14.254748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:14.254748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:14.255611 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:14.255611 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:14.255611 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:14.255611 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:14.255611 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:14.255611 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:14.255611 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:14.255611 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:14.255611 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:14.255611 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:14.255611 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:14.255611 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:14.255611 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:14.255611 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:14.255611 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:14.255611 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:14.256372 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:14.256372 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:14.256372 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:14.256372 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:14.256372 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:14.256372 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:14.256372 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:14.256372 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:14.256372 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:14.256372 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:14.256372 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:14.256372 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:14.256372 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 40/78] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:14.257037 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e22b8-04f9-4c9d-b427-7de7abb57e19 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:14.314102 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9145542b-b4e0-4dfc-b764-ad096e940aa4 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:14.340286 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:14.348439 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c1cc3-c3fd-4165-9087-92c599060295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:14.352681 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c1cc3-c3fd-4165-9087-92c599060295 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:14.352681 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c1cc3-c3fd-4165-9087-92c599060295 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:14.352681 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7c1cc3-c3fd-4165-9087-92c599060295 None admin] PATH_INFO: `/v3/users/f6c5e41e9bbe4c8e8a2622938ac4f876` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:14.363964 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e22b8-04f9-4c9d-b427-7de7abb57e19 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:14.364883 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c1cc3-c3fd-4165-9087-92c599060295 None admin] RBAC: Authorizing `identity:get_user(user_id=f6c5e41e9bbe4c8e8a2622938ac4f876)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:14.366342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7c1cc3-c3fd-4165-9087-92c599060295 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:14.368358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 39/79] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:14 2022] GET /identity/v3/users/f6c5e41e9bbe4c8e8a2622938ac4f876 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:14.368972 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c1cc3-c3fd-4165-9087-92c599060295 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:14.401320 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f8ec0-5c77-4fab-8408-f866b1d4fde4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:14.402129 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f8ec0-5c77-4fab-8408-f866b1d4fde4 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:14.402417 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f8ec0-5c77-4fab-8408-f866b1d4fde4 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:14.402694 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617f8ec0-5c77-4fab-8408-f866b1d4fde4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:14.403965 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f8ec0-5c77-4fab-8408-f866b1d4fde4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:14.405516 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617f8ec0-5c77-4fab-8408-f866b1d4fde4 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:14.407062 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:14.407259 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 41/80] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:38:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:14.408021 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f8ec0-5c77-4fab-8408-f866b1d4fde4 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:14.480369 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7c1cc3-c3fd-4165-9087-92c599060295 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:14.512182 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617f8ec0-5c77-4fab-8408-f866b1d4fde4 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:14.518265 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040643c-755b-402d-8c56-f119171cfdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:14.519156 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040643c-755b-402d-8c56-f119171cfdb6 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:14.519701 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040643c-755b-402d-8c56-f119171cfdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:14.520035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3040643c-755b-402d-8c56-f119171cfdb6 None admin] PATH_INFO: `/v3/users/f6c5e41e9bbe4c8e8a2622938ac4f876` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:14.521414 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040643c-755b-402d-8c56-f119171cfdb6 None admin] RBAC: Authorizing `identity:get_user(user_id=f6c5e41e9bbe4c8e8a2622938ac4f876)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:14.522892 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3040643c-755b-402d-8c56-f119171cfdb6 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:14.524624 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 40/81] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:14 2022] GET /identity/v3/users/f6c5e41e9bbe4c8e8a2622938ac4f876 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:14.525401 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040643c-755b-402d-8c56-f119171cfdb6 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:14.547061 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455180f-357b-48e8-87b6-caec70b8b81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:14.547917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455180f-357b-48e8-87b6-caec70b8b81a None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:14.548202 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455180f-357b-48e8-87b6-caec70b8b81a None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:14.548521 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d455180f-357b-48e8-87b6-caec70b8b81a None admin] PATH_INFO: `/v3/users/c9c77caa8ec1422eb63723b3db112685` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:14.549731 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455180f-357b-48e8-87b6-caec70b8b81a None admin] RBAC: Authorizing `identity:get_user(user_id=c9c77caa8ec1422eb63723b3db112685)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:14.551236 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d455180f-357b-48e8-87b6-caec70b8b81a None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:14.552907 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 42/82] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:14 2022] GET /identity/v3/users/c9c77caa8ec1422eb63723b3db112685 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:14.552907 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455180f-357b-48e8-87b6-caec70b8b81a None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:14.568404 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:14.634209 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3040643c-755b-402d-8c56-f119171cfdb6 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:14.636590 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:14.657517 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d455180f-357b-48e8-87b6-caec70b8b81a None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:14.670468 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8961f-c1fc-460f-ad9d-26a7d40c440e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:14.671143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8961f-c1fc-460f-ad9d-26a7d40c440e None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:14.671975 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8961f-c1fc-460f-ad9d-26a7d40c440e None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:14.672246 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8961f-c1fc-460f-ad9d-26a7d40c440e None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:14.673025 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8961f-c1fc-460f-ad9d-26a7d40c440e None admin] RBAC: Adding query filter params (name=member) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:14.673513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8961f-c1fc-460f-ad9d-26a7d40c440e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:14.674922 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8961f-c1fc-460f-ad9d-26a7d40c440e None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:14.683268 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 41/83] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:14.684050 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8961f-c1fc-460f-ad9d-26a7d40c440e None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:14.696750 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2dfee-8b53-48e2-96be-988d43876153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:14.697398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2dfee-8b53-48e2-96be-988d43876153 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:14.697682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2dfee-8b53-48e2-96be-988d43876153 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:14.701846 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd2dfee-8b53-48e2-96be-988d43876153 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:14.767641 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2dfee-8b53-48e2-96be-988d43876153 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:14.769447 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd2dfee-8b53-48e2-96be-988d43876153 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:14.782899 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:14.788594 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8961f-c1fc-460f-ad9d-26a7d40c440e None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:14.823758 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775ce02-b93e-40eb-9d7e-c81a264da05d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:14.824467 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775ce02-b93e-40eb-9d7e-c81a264da05d None admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:14.824765 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775ce02-b93e-40eb-9d7e-c81a264da05d None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:14.825052 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775ce02-b93e-40eb-9d7e-c81a264da05d None admin] PATH_INFO: `/v3/users` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:14.825765 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775ce02-b93e-40eb-9d7e-c81a264da05d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:14.827226 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775ce02-b93e-40eb-9d7e-c81a264da05d None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:14.867389 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 43/84] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:14.868214 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2dfee-8b53-48e2-96be-988d43876153 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:14.929204 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 42/85] 10.222.0.62 () {60 vars in 1132 bytes} [Wed May 25 15:38:14 2022] POST /identity/v3/users => generated 289 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:38:14.929925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775ce02-b93e-40eb-9d7e-c81a264da05d None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:14.961221 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:14.977740 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd2dfee-8b53-48e2-96be-988d43876153 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:14.993833 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:15.025028 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38519897-8c93-427d-a3a2-fd98029db51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:15.025028 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38519897-8c93-427d-a3a2-fd98029db51a None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:15.025028 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38519897-8c93-427d-a3a2-fd98029db51a None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:15.025028 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38519897-8c93-427d-a3a2-fd98029db51a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:15.065247 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775ce02-b93e-40eb-9d7e-c81a264da05d None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:15.102480 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38519897-8c93-427d-a3a2-fd98029db51a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:15.104001 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38519897-8c93-427d-a3a2-fd98029db51a None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:15.110056 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3a3f8-eaab-4b22-893d-e6addc37dcee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:15.110821 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3a3f8-eaab-4b22-893d-e6addc37dcee None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:15.111184 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3a3f8-eaab-4b22-893d-e6addc37dcee None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:15.111542 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f3a3f8-eaab-4b22-893d-e6addc37dcee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:15.194113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3a3f8-eaab-4b22-893d-e6addc37dcee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:15.195609 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f3a3f8-eaab-4b22-893d-e6addc37dcee None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:15.228347 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:15.243077 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 44/86] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:15.245525 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38519897-8c93-427d-a3a2-fd98029db51a None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:15.263795 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:15.331427 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 43/87] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:15.332759 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3a3f8-eaab-4b22-893d-e6addc37dcee None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:15.376171 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38519897-8c93-427d-a3a2-fd98029db51a None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:15.422455 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84dd2e-fdb2-4900-b2ca-551d018368bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:15.424258 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84dd2e-fdb2-4900-b2ca-551d018368bf None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:15.424586 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84dd2e-fdb2-4900-b2ca-551d018368bf None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:15.424870 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c84dd2e-fdb2-4900-b2ca-551d018368bf None admin] PATH_INFO: `/v3/users/f6c5e41e9bbe4c8e8a2622938ac4f876` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:15.426145 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84dd2e-fdb2-4900-b2ca-551d018368bf None admin] RBAC: Authorizing `identity:get_user(user_id=f6c5e41e9bbe4c8e8a2622938ac4f876)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:15.427619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c84dd2e-fdb2-4900-b2ca-551d018368bf None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:15.429317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 45/88] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:15 2022] GET /identity/v3/users/f6c5e41e9bbe4c8e8a2622938ac4f876 => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:15.430739 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84dd2e-fdb2-4900-b2ca-551d018368bf None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:15.462293 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f3a3f8-eaab-4b22-893d-e6addc37dcee None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:15.489772 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:15.502567 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd987e0-35d7-4b98-9f25-fabfd8795e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:15.506022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd987e0-35d7-4b98-9f25-fabfd8795e5f None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:15.506022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd987e0-35d7-4b98-9f25-fabfd8795e5f None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:15.506022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd987e0-35d7-4b98-9f25-fabfd8795e5f None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:15.506022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd987e0-35d7-4b98-9f25-fabfd8795e5f None admin] RBAC: Authorizing `identity:get_project(project_id=6daed429aa5449e2923488e535a6a243)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:15.507672 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd987e0-35d7-4b98-9f25-fabfd8795e5f None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:15.509699 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 44/89] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:15 2022] GET /identity/v3/projects/6daed429aa5449e2923488e535a6a243 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:15.510837 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd987e0-35d7-4b98-9f25-fabfd8795e5f None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:15.539810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:15.566660 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c84dd2e-fdb2-4900-b2ca-551d018368bf None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:15.613840 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b2200-5a2a-4906-9445-3746d51c6fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:15.614644 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b2200-5a2a-4906-9445-3746d51c6fc5 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:15.614929 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b2200-5a2a-4906-9445-3746d51c6fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:15.615211 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7b2200-5a2a-4906-9445-3746d51c6fc5 None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:15.617008 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b2200-5a2a-4906-9445-3746d51c6fc5 None admin] RBAC: Authorizing `identity:get_project(project_id=6daed429aa5449e2923488e535a6a243)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:15.618456 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7b2200-5a2a-4906-9445-3746d51c6fc5 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:15.623397 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 46/90] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:15 2022] GET /identity/v3/projects/6daed429aa5449e2923488e535a6a243 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:15.623397 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b2200-5a2a-4906-9445-3746d51c6fc5 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:15.643252 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd987e0-35d7-4b98-9f25-fabfd8795e5f None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:15.691398 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fdc66-441b-4ec1-b6e8-1b852642c5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:15.692956 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fdc66-441b-4ec1-b6e8-1b852642c5ef None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:15.693256 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fdc66-441b-4ec1-b6e8-1b852642c5ef None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:15.693610 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289fdc66-441b-4ec1-b6e8-1b852642c5ef None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:15.695470 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fdc66-441b-4ec1-b6e8-1b852642c5ef None admin] RBAC: Authorizing `identity:get_project(project_id=6daed429aa5449e2923488e535a6a243)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:15.697244 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289fdc66-441b-4ec1-b6e8-1b852642c5ef None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:15.699392 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 45/91] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:15 2022] GET /identity/v3/projects/6daed429aa5449e2923488e535a6a243 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:15.700028 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fdc66-441b-4ec1-b6e8-1b852642c5ef None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:15.742959 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7b2200-5a2a-4906-9445-3746d51c6fc5 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:15.774705 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:15.791912 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea947d-c402-454d-866f-26fb80f3ff2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:15.792674 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea947d-c402-454d-866f-26fb80f3ff2d None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:15.793478 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea947d-c402-454d-866f-26fb80f3ff2d None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:15.793764 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea947d-c402-454d-866f-26fb80f3ff2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:15.818823 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:15.821293 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289fdc66-441b-4ec1-b6e8-1b852642c5ef None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:15.858338 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcb29d-d20b-4d02-932e-0cadae3ecd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:15.859565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcb29d-d20b-4d02-932e-0cadae3ecd1b None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:15.859783 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcb29d-d20b-4d02-932e-0cadae3ecd1b None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:15.860170 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcb29d-d20b-4d02-932e-0cadae3ecd1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:15.861153 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcb29d-d20b-4d02-932e-0cadae3ecd1b None admin] RBAC: Adding query filter params (role.id=5614294f6ab949a99424ee6e983b6430, scope.project.id=6daed429aa5449e2923488e535a6a243, user.id=f6c5e41e9bbe4c8e8a2622938ac4f876) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:15.866917 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcb29d-d20b-4d02-932e-0cadae3ecd1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:15.866917 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bcb29d-d20b-4d02-932e-0cadae3ecd1b None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:15.869536 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 46/92] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:38:15 2022] GET /identity/v3/role_assignments?user.id=f6c5e41e9bbe4c8e8a2622938ac4f876&scope.project.id=6daed429aa5449e2923488e535a6a243&role.id=5614294f6ab949a99424ee6e983b6430 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:15.870531 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcb29d-d20b-4d02-932e-0cadae3ecd1b None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:15.888920 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea947d-c402-454d-866f-26fb80f3ff2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:15.891120 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea947d-c402-454d-866f-26fb80f3ff2d None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:15.998174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bcb29d-d20b-4d02-932e-0cadae3ecd1b None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:16.024807 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:16.032332 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 47/93] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:16.032524 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea947d-c402-454d-866f-26fb80f3ff2d None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:16.044843 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70c998-2f1c-49bc-a699-5f8896165ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:16.045838 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70c998-2f1c-49bc-a699-5f8896165ca4 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:16.046253 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70c998-2f1c-49bc-a699-5f8896165ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:16.047637 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70c998-2f1c-49bc-a699-5f8896165ca4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:16.048539 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70c998-2f1c-49bc-a699-5f8896165ca4 None admin] RBAC: Adding query filter params (role.id=abd8e1d1d7cd45cc93ed82f651c74d9b, scope.project.id=6daed429aa5449e2923488e535a6a243, user.id=f6c5e41e9bbe4c8e8a2622938ac4f876) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:16.049042 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70c998-2f1c-49bc-a699-5f8896165ca4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:16.050969 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70c998-2f1c-49bc-a699-5f8896165ca4 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:16.057771 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 47/94] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:38:15 2022] GET /identity/v3/role_assignments?user.id=f6c5e41e9bbe4c8e8a2622938ac4f876&scope.project.id=6daed429aa5449e2923488e535a6a243&role.id=abd8e1d1d7cd45cc93ed82f651c74d9b => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:16.058962 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70c998-2f1c-49bc-a699-5f8896165ca4 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:16.133572 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:16.266066 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea947d-c402-454d-866f-26fb80f3ff2d None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:16.342603 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70c998-2f1c-49bc-a699-5f8896165ca4 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:16.353180 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fd308-260e-46dd-978e-72e20bdc8930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:16.353880 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fd308-260e-46dd-978e-72e20bdc8930 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:16.354171 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fd308-260e-46dd-978e-72e20bdc8930 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:16.354453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fd308-260e-46dd-978e-72e20bdc8930 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:16.355309 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836fd308-260e-46dd-978e-72e20bdc8930 None admin] RBAC: Adding query filter params (role.id=ae72bfdddd1e4a94a21a0d53264ee157, scope.project.id=6daed429aa5449e2923488e535a6a243, user.id=c9c77caa8ec1422eb63723b3db112685) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:16.355630 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836fd308-260e-46dd-978e-72e20bdc8930 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:16.357117 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836fd308-260e-46dd-978e-72e20bdc8930 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:16.375451 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 48/95] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:38:16 2022] GET /identity/v3/role_assignments?user.id=c9c77caa8ec1422eb63723b3db112685&scope.project.id=6daed429aa5449e2923488e535a6a243&role.id=ae72bfdddd1e4a94a21a0d53264ee157 => generated 259 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:16.389643 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab912bf8-9deb-47d5-afba-dc62a2058750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:16.391050 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab912bf8-9deb-47d5-afba-dc62a2058750 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:16.391438 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab912bf8-9deb-47d5-afba-dc62a2058750 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:16.391624 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab912bf8-9deb-47d5-afba-dc62a2058750 None admin] PATH_INFO: `/v3/projects/caaffec5146d4d0da757c5eaff7dc451` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:16.401231 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab912bf8-9deb-47d5-afba-dc62a2058750 None admin] RBAC: Authorizing `identity:get_project(project_id=caaffec5146d4d0da757c5eaff7dc451)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:16.402837 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab912bf8-9deb-47d5-afba-dc62a2058750 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:16.404830 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 48/96] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:16 2022] GET /identity/v3/projects/caaffec5146d4d0da757c5eaff7dc451 => generated 312 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:16.411853 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fd308-260e-46dd-978e-72e20bdc8930 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:16.550772 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fd308-260e-46dd-978e-72e20bdc8930 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:16.576823 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:16.588673 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6c33a-7c4e-4735-bc60-ed8217611e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:16.589413 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6c33a-7c4e-4735-bc60-ed8217611e54 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:16.589709 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6c33a-7c4e-4735-bc60-ed8217611e54 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:16.589992 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6c33a-7c4e-4735-bc60-ed8217611e54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:16.590846 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6c33a-7c4e-4735-bc60-ed8217611e54 None admin] RBAC: Adding query filter params (role.id=5614294f6ab949a99424ee6e983b6430, scope.project.id=caaffec5146d4d0da757c5eaff7dc451, user.id=f6c5e41e9bbe4c8e8a2622938ac4f876) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:16.591162 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6c33a-7c4e-4735-bc60-ed8217611e54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:16.592665 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6c33a-7c4e-4735-bc60-ed8217611e54 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:16.600017 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 49/97] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:38:16 2022] GET /identity/v3/role_assignments?user.id=f6c5e41e9bbe4c8e8a2622938ac4f876&scope.project.id=caaffec5146d4d0da757c5eaff7dc451&role.id=5614294f6ab949a99424ee6e983b6430 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:17.916312 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917c525-0fb8-4b74-bb13-34424c0eef88 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:17.917398 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917c525-0fb8-4b74-bb13-34424c0eef88 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:17.917912 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917c525-0fb8-4b74-bb13-34424c0eef88 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:17.919816 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 49/98] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:17.925222 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb45867-4e4e-4a9e-a510-9ee33541bfcf None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:17.926107 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb45867-4e4e-4a9e-a510-9ee33541bfcf None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:17.926586 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb45867-4e4e-4a9e-a510-9ee33541bfcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:17.947938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-ddb45867-4e4e-4a9e-a510-9ee33541bfcf None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:17.949517 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-ddb45867-4e4e-4a9e-a510-9ee33541bfcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:17.986594 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfc228-5ba1-40b0-998f-c22b9b2b0c57 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:17.987218 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfc228-5ba1-40b0-998f-c22b9b2b0c57 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:17.987695 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cfc228-5ba1-40b0-998f-c22b9b2b0c57 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:17.989363 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 50/99] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:38:17.994381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48d3d6-a30d-4051-936c-dd9c82116baa None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:17.994677 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48d3d6-a30d-4051-936c-dd9c82116baa None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:17.994963 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c48d3d6-a30d-4051-936c-dd9c82116baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:18.021797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-5c48d3d6-a30d-4051-936c-dd9c82116baa None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:18.023023 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-5c48d3d6-a30d-4051-936c-dd9c82116baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:18.084278 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 50/100] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:18.132117 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb45867-4e4e-4a9e-a510-9ee33541bfcf None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:18.177366 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:18.207715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 51/101] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:38:18.256979 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48d3d6-a30d-4051-936c-dd9c82116baa None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:18.343774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb45867-4e4e-4a9e-a510-9ee33541bfcf None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:18.355763 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:18.398445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54eb585-4bf4-40f2-bfa4-b762ff2060cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:18.399280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eb585-4bf4-40f2-bfa4-b762ff2060cf None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:18.399573 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eb585-4bf4-40f2-bfa4-b762ff2060cf None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:18.399851 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54eb585-4bf4-40f2-bfa4-b762ff2060cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:18.415801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54eb585-4bf4-40f2-bfa4-b762ff2060cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:18.430350 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-a54eb585-4bf4-40f2-bfa4-b762ff2060cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:38:18.430350 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:18.430350 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:18.430350 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:18.430350 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:18.430350 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:18.430350 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:18.430350 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:18.430350 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:18.430350 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:18.430350 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:18.430350 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:18.430350 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:18.430350 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:18.430350 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:18.430350 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:18.431599 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:18.431599 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:18.431599 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:18.431599 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:18.431599 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:18.431599 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:18.431599 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:18.431599 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:18.431599 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:18.431599 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:18.431599 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:18.431599 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:18.431599 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:18.431599 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:18.431599 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:18.431599 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:18.432574 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:18.432574 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:18.432574 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:18.432574 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:18.432574 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:18.432574 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:18.432574 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:18.432574 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:18.432574 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:18.432574 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:18.432574 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:38:18.432574 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:18.434686 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 51/102] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:18.445740 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54eb585-4bf4-40f2-bfa4-b762ff2060cf None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:18.512481 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c48d3d6-a30d-4051-936c-dd9c82116baa None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:18.573165 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644dd3e-5b1c-4e40-879e-2be55fe10f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:18.573989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644dd3e-5b1c-4e40-879e-2be55fe10f3c None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:18.574277 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644dd3e-5b1c-4e40-879e-2be55fe10f3c None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:18.574553 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644dd3e-5b1c-4e40-879e-2be55fe10f3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:18.575790 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644dd3e-5b1c-4e40-879e-2be55fe10f3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:18.577296 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644dd3e-5b1c-4e40-879e-2be55fe10f3c None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:18.580056 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 52/103] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:38:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:18.589437 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644dd3e-5b1c-4e40-879e-2be55fe10f3c None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:18.641086 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54eb585-4bf4-40f2-bfa4-b762ff2060cf None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:18.697409 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:18.709251 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ad026-dff3-4928-a87d-f00e5a8913f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:18.710022 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ad026-dff3-4928-a87d-f00e5a8913f9 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:18.710314 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ad026-dff3-4928-a87d-f00e5a8913f9 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:18.710598 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ad026-dff3-4928-a87d-f00e5a8913f9 None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:18.711374 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ad026-dff3-4928-a87d-f00e5a8913f9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:18.711691 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ad026-dff3-4928-a87d-f00e5a8913f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:18.713128 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ad026-dff3-4928-a87d-f00e5a8913f9 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:18.726738 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 52/104] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:18.737768 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ad026-dff3-4928-a87d-f00e5a8913f9 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:18.781705 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644dd3e-5b1c-4e40-879e-2be55fe10f3c None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:18.808892 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:18.853203 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443965c-c7aa-4a9c-9f56-e11106100972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:18.853889 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443965c-c7aa-4a9c-9f56-e11106100972 None admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:18.854180 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443965c-c7aa-4a9c-9f56-e11106100972 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:18.854459 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c443965c-c7aa-4a9c-9f56-e11106100972 None admin] PATH_INFO: `/v3/projects` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:18.855189 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443965c-c7aa-4a9c-9f56-e11106100972 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:18.856687 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c443965c-c7aa-4a9c-9f56-e11106100972 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:18.920140 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ad026-dff3-4928-a87d-f00e5a8913f9 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:18.966472 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 53/105] 10.222.0.62 () {60 vars in 1141 bytes} [Wed May 25 15:38:18 2022] POST /identity/v3/projects => generated 302 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:38:18.970499 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2dc81-fb74-4287-bbd3-889e65909066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:18.972097 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2dc81-fb74-4287-bbd3-889e65909066 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:18.972743 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2dc81-fb74-4287-bbd3-889e65909066 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:18.973230 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c2dc81-fb74-4287-bbd3-889e65909066 None admin] PATH_INFO: `/v3/users/bddc0a7e1d2d459ab04416e4c32f15a7` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:18.990233 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2dc81-fb74-4287-bbd3-889e65909066 None admin] RBAC: Authorizing `identity:get_user(user_id=bddc0a7e1d2d459ab04416e4c32f15a7)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:18.992085 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c2dc81-fb74-4287-bbd3-889e65909066 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:18.994619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 53/106] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:18 2022] GET /identity/v3/users/bddc0a7e1d2d459ab04416e4c32f15a7 => generated 289 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:19.001183 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443965c-c7aa-4a9c-9f56-e11106100972 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:19.173601 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c443965c-c7aa-4a9c-9f56-e11106100972 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:19.176015 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:19.216134 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bfb80-ec99-4ae0-8208-7eb30e582b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:19.216898 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bfb80-ec99-4ae0-8208-7eb30e582b1f None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:19.217132 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bfb80-ec99-4ae0-8208-7eb30e582b1f None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:19.217413 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821bfb80-ec99-4ae0-8208-7eb30e582b1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:19.317247 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821bfb80-ec99-4ae0-8208-7eb30e582b1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:19.318761 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821bfb80-ec99-4ae0-8208-7eb30e582b1f None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:19.436942 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 54/107] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:19.443044 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2dc81-fb74-4287-bbd3-889e65909066 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:19.558380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:19.578673 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c2dc81-fb74-4287-bbd3-889e65909066 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:19.622043 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a90a097-2395-4259-91bc-c8e6efb859f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:19.622925 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90a097-2395-4259-91bc-c8e6efb859f7 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:19.623209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90a097-2395-4259-91bc-c8e6efb859f7 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:19.623485 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a90a097-2395-4259-91bc-c8e6efb859f7 None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:19.625054 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90a097-2395-4259-91bc-c8e6efb859f7 None admin] RBAC: Authorizing `identity:get_project(project_id=6daed429aa5449e2923488e535a6a243)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:19.626718 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a90a097-2395-4259-91bc-c8e6efb859f7 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:19.630903 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 54/108] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:19 2022] GET /identity/v3/projects/6daed429aa5449e2923488e535a6a243 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:19.634792 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bfb80-ec99-4ae0-8208-7eb30e582b1f None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:19.638160 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:19.673758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f02d6d-dff7-498e-bbb0-a1fbefd620ed None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:19.674234 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f02d6d-dff7-498e-bbb0-a1fbefd620ed None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:19.674517 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f02d6d-dff7-498e-bbb0-a1fbefd620ed None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:19.675878 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 55/109] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:38:19.681536 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5299de5-42bb-41b8-a2c2-a49e6fae8bb0 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:19.681832 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5299de5-42bb-41b8-a2c2-a49e6fae8bb0 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:19.682121 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5299de5-42bb-41b8-a2c2-a49e6fae8bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:19.717528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-e5299de5-42bb-41b8-a2c2-a49e6fae8bb0 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:19.719452 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-e5299de5-42bb-41b8-a2c2-a49e6fae8bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:19.746606 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821bfb80-ec99-4ae0-8208-7eb30e582b1f None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:19.783528 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe24c7-1e74-42a2-ad4c-9c9973733fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:19.784189 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe24c7-1e74-42a2-ad4c-9c9973733fed None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:19.784503 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe24c7-1e74-42a2-ad4c-9c9973733fed None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:19.784843 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe24c7-1e74-42a2-ad4c-9c9973733fed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:19.785680 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe24c7-1e74-42a2-ad4c-9c9973733fed None admin] RBAC: Adding query filter params (role.id=29ddb77b56f449aa87fa909f2eebe434, scope.project.id=6daed429aa5449e2923488e535a6a243, user.id=bddc0a7e1d2d459ab04416e4c32f15a7) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:19.785990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe24c7-1e74-42a2-ad4c-9c9973733fed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:19.787799 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe24c7-1e74-42a2-ad4c-9c9973733fed None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:19.797146 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 55/110] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:38:19 2022] GET /identity/v3/role_assignments?user.id=bddc0a7e1d2d459ab04416e4c32f15a7&scope.project.id=6daed429aa5449e2923488e535a6a243&role.id=29ddb77b56f449aa87fa909f2eebe434 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:19.800436 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e002b-4d5c-4dcf-906d-78270f865196 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:19.800436 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e002b-4d5c-4dcf-906d-78270f865196 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:19.800436 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3e002b-4d5c-4dcf-906d-78270f865196 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:19.814268 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 56/111] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:19 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:19.815236 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d3269-4fe8-4a7a-8b40-e592b6a5a5de None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:19.815537 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d3269-4fe8-4a7a-8b40-e592b6a5a5de None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:19.815822 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3d3269-4fe8-4a7a-8b40-e592b6a5a5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:19.849596 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-0b3d3269-4fe8-4a7a-8b40-e592b6a5a5de None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:19.854517 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-0b3d3269-4fe8-4a7a-8b40-e592b6a5a5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:19.856114 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 56/112] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:38:19.898532 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafd551-9fac-4187-b35d-071c4e955f49 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:19.898893 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafd551-9fac-4187-b35d-071c4e955f49 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:19.899106 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fafd551-9fac-4187-b35d-071c4e955f49 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:19.900529 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 57/113] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:38:19.901292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafd551-9fac-4187-b35d-071c4e955f49 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:19.997321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:20.005568 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 57/114] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:20.007890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e460a-5b8b-4bc8-a501-5185d9d72018 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:20.008194 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e460a-5b8b-4bc8-a501-5185d9d72018 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:20.008506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8e460a-5b8b-4bc8-a501-5185d9d72018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:20.047028 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-7b8e460a-5b8b-4bc8-a501-5185d9d72018 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:20.048280 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-7b8e460a-5b8b-4bc8-a501-5185d9d72018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:20.095865 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:20.102706 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fafd551-9fac-4187-b35d-071c4e955f49 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:20.171896 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac2498-2886-4853-948f-7a279af97cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:20.173357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac2498-2886-4853-948f-7a279af97cc3 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:20.173848 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac2498-2886-4853-948f-7a279af97cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:20.174363 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac2498-2886-4853-948f-7a279af97cc3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:20.186524 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acac2498-2886-4853-948f-7a279af97cc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:20.195999 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-acac2498-2886-4853-948f-7a279af97cc3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:20.195999 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:20.195999 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:20.195999 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:20.195999 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:20.195999 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:20.195999 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:20.195999 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:20.195999 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:20.195999 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:20.195999 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:20.195999 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:20.195999 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:20.195999 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:20.195999 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:20.195999 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:20.196938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:20.196938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:20.196938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:20.196938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:20.196938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:20.196938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:20.196938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:20.196938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:20.196938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:20.196938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:20.196938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:20.196938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:20.196938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:20.196938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:20.196938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:20.196938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:20.197702 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:20.197702 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:20.197702 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:20.197702 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:20.197702 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:20.197702 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:20.197702 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:20.197702 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:20.197702 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:20.197702 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:20.197702 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:20.197702 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:20.204967 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 58/115] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:20.206139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac2498-2886-4853-948f-7a279af97cc3 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:20.261816 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 58/116] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:20.261816 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e460a-5b8b-4bc8-a501-5185d9d72018 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:20.354815 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac2498-2886-4853-948f-7a279af97cc3 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:20.398007 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63157527-da90-44e5-b38b-3aee8c20dc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:20.399529 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63157527-da90-44e5-b38b-3aee8c20dc4d None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:20.400136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63157527-da90-44e5-b38b-3aee8c20dc4d None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:20.400732 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63157527-da90-44e5-b38b-3aee8c20dc4d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:20.415355 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63157527-da90-44e5-b38b-3aee8c20dc4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:20.426188 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-63157527-da90-44e5-b38b-3aee8c20dc4d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:38:20.426188 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:20.426188 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:20.426188 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:20.426188 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:20.426188 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:20.426188 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:20.426188 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:20.426188 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:20.426188 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:20.426188 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:20.426188 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:20.426188 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:20.426188 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:20.426188 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:20.426188 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:20.427148 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:20.427148 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:20.427148 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:20.427148 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:20.427148 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:20.427148 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:20.427148 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:20.427148 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:20.427148 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:20.427148 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:20.427148 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:20.427148 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:20.427148 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:20.427148 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:20.427148 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:20.427148 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:20.427916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:20.427916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:20.427916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:20.427916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:20.427916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:20.427916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:20.427916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:20.427916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:20.427916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:20.427916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:20.427916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:38:20.427916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:20.430687 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 59/117] 10.222.0.62 () {56 vars in 1114 bytes} [Wed May 25 15:38:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:20.432072 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63157527-da90-44e5-b38b-3aee8c20dc4d None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:20.444842 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:20.528660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8e460a-5b8b-4bc8-a501-5185d9d72018 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:20.565371 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:20.576018 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb732f8-c3b2-434f-9f77-9fbc8672d376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:20.576811 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb732f8-c3b2-434f-9f77-9fbc8672d376 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:20.577103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb732f8-c3b2-434f-9f77-9fbc8672d376 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:20.577387 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb732f8-c3b2-434f-9f77-9fbc8672d376 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:20.578215 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb732f8-c3b2-434f-9f77-9fbc8672d376 None admin] RBAC: Adding query filter params (name=member) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:20.578636 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63157527-da90-44e5-b38b-3aee8c20dc4d None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:20.578743 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb732f8-c3b2-434f-9f77-9fbc8672d376 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:20.579955 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb732f8-c3b2-434f-9f77-9fbc8672d376 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:20.588849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 59/118] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:20.592887 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb732f8-c3b2-434f-9f77-9fbc8672d376 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:20.631936 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dac6a-255f-4831-9e07-0d8f34c87e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:20.633102 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dac6a-255f-4831-9e07-0d8f34c87e46 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:20.633574 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dac6a-255f-4831-9e07-0d8f34c87e46 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:20.634029 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dac6a-255f-4831-9e07-0d8f34c87e46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:20.648946 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6dac6a-255f-4831-9e07-0d8f34c87e46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:20.660035 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-8b6dac6a-255f-4831-9e07-0d8f34c87e46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:38:20.660035 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:20.660035 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:20.660035 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:20.660035 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:20.660035 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:20.660035 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:20.660035 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:20.660035 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:20.660035 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:20.660035 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:20.660035 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:20.660035 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:20.660035 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:20.660035 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:20.660035 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:20.661136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:20.661136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:20.661136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:20.661136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:20.661136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:20.661136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:20.661136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:20.661136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:20.661136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:20.661136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:20.661136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:20.661136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:20.661136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:20.661136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:20.661136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:20.661136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:20.661997 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:20.661997 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:20.661997 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:20.661997 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:20.661997 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:20.661997 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:20.661997 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:20.661997 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:20.661997 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:20.661997 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:20.661997 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:38:20.661997 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:20.664274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 60/119] 10.222.0.62 () {56 vars in 1096 bytes} [Wed May 25 15:38:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:20.671086 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbd603-3adb-4843-a95f-64c001069760 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:20.671625 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbd603-3adb-4843-a95f-64c001069760 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:20.672084 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbd603-3adb-4843-a95f-64c001069760 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:20.676164 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 61/120] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:20.677425 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbd603-3adb-4843-a95f-64c001069760 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:20.724661 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb732f8-c3b2-434f-9f77-9fbc8672d376 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:20.761960 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b85b8-b1d4-4f9a-b236-33a06ca74ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:20.762970 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b85b8-b1d4-4f9a-b236-33a06ca74ea1 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:20.763433 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b85b8-b1d4-4f9a-b236-33a06ca74ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:20.763891 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95b85b8-b1d4-4f9a-b236-33a06ca74ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:20.764347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:20.765642 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b85b8-b1d4-4f9a-b236-33a06ca74ea1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:20.766190 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b85b8-b1d4-4f9a-b236-33a06ca74ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:20.767842 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95b85b8-b1d4-4f9a-b236-33a06ca74ea1 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:20.777565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 60/121] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:38:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:20.778958 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b85b8-b1d4-4f9a-b236-33a06ca74ea1 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:20.819912 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbd603-3adb-4843-a95f-64c001069760 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:20.856727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:20.879396 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8d38b7-f0f3-46ba-8d2a-4415e5e91963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:20.880291 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d38b7-f0f3-46ba-8d2a-4415e5e91963 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:20.880633 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d38b7-f0f3-46ba-8d2a-4415e5e91963 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:20.880914 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8d38b7-f0f3-46ba-8d2a-4415e5e91963 None admin] PATH_INFO: `/v3/users/f6c5e41e9bbe4c8e8a2622938ac4f876` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:20.883211 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d38b7-f0f3-46ba-8d2a-4415e5e91963 None admin] RBAC: Authorizing `identity:get_user(user_id=f6c5e41e9bbe4c8e8a2622938ac4f876)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:20.884660 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8d38b7-f0f3-46ba-8d2a-4415e5e91963 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:20.886430 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 62/122] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:20 2022] GET /identity/v3/users/f6c5e41e9bbe4c8e8a2622938ac4f876 => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:20.888183 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b7774-74f7-49c1-8d9b-6db9aae9aa4f None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:20.888183 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b7774-74f7-49c1-8d9b-6db9aae9aa4f None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:20.888355 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5b7774-74f7-49c1-8d9b-6db9aae9aa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:20.909003 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-fb5b7774-74f7-49c1-8d9b-6db9aae9aa4f None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:20.910239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-fb5b7774-74f7-49c1-8d9b-6db9aae9aa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:20.932450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95b85b8-b1d4-4f9a-b236-33a06ca74ea1 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:20.985410 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc22c3-b2fb-4e5f-b14e-f68050d23462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:20.986588 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc22c3-b2fb-4e5f-b14e-f68050d23462 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:20.987079 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc22c3-b2fb-4e5f-b14e-f68050d23462 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:20.987860 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fc22c3-b2fb-4e5f-b14e-f68050d23462 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:20.989270 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc22c3-b2fb-4e5f-b14e-f68050d23462 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:20.990206 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc22c3-b2fb-4e5f-b14e-f68050d23462 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:20.992400 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fc22c3-b2fb-4e5f-b14e-f68050d23462 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:21.006345 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 63/123] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:21.007559 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b7774-74f7-49c1-8d9b-6db9aae9aa4f None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:21.014451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 61/124] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:21.016430 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc22c3-b2fb-4e5f-b14e-f68050d23462 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:21.079963 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:21.139928 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5b7774-74f7-49c1-8d9b-6db9aae9aa4f None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:21.199097 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea252855-0c2f-4cb2-91d8-f14eb07b8ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:21.200329 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea252855-0c2f-4cb2-91d8-f14eb07b8ea2 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:21.200329 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea252855-0c2f-4cb2-91d8-f14eb07b8ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:21.200628 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea252855-0c2f-4cb2-91d8-f14eb07b8ea2 None admin] PATH_INFO: `/v3/users/f6c5e41e9bbe4c8e8a2622938ac4f876` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:21.201863 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea252855-0c2f-4cb2-91d8-f14eb07b8ea2 None admin] RBAC: Authorizing `identity:get_user(user_id=f6c5e41e9bbe4c8e8a2622938ac4f876)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:21.204667 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea252855-0c2f-4cb2-91d8-f14eb07b8ea2 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:21.206588 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 64/125] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:21 2022] GET /identity/v3/users/f6c5e41e9bbe4c8e8a2622938ac4f876 => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:21.211049 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea252855-0c2f-4cb2-91d8-f14eb07b8ea2 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:21.229726 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fc22c3-b2fb-4e5f-b14e-f68050d23462 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:21.250512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:21.283107 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c9e8c-0647-41d5-953b-b7e0323ae3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:21.284632 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c9e8c-0647-41d5-953b-b7e0323ae3fe None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:21.285582 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c9e8c-0647-41d5-953b-b7e0323ae3fe None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:21.286290 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c9e8c-0647-41d5-953b-b7e0323ae3fe None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:21.287800 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c9e8c-0647-41d5-953b-b7e0323ae3fe None admin] RBAC: Authorizing `identity:get_project(project_id=6daed429aa5449e2923488e535a6a243)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:21.289727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c9e8c-0647-41d5-953b-b7e0323ae3fe None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:21.292489 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 62/126] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:21 2022] GET /identity/v3/projects/6daed429aa5449e2923488e535a6a243 => generated 298 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:21.295180 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c9e8c-0647-41d5-953b-b7e0323ae3fe None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:21.329829 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea252855-0c2f-4cb2-91d8-f14eb07b8ea2 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:21.369823 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:21.378102 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1f3c1-618c-4330-b807-4a5a0f022386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:21.379739 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1f3c1-618c-4330-b807-4a5a0f022386 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:21.380462 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1f3c1-618c-4330-b807-4a5a0f022386 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:21.380905 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1f3c1-618c-4330-b807-4a5a0f022386 None admin] PATH_INFO: `/v3/users/c9c77caa8ec1422eb63723b3db112685` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:21.385314 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1f3c1-618c-4330-b807-4a5a0f022386 None admin] RBAC: Authorizing `identity:get_user(user_id=c9c77caa8ec1422eb63723b3db112685)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:21.385314 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b1f3c1-618c-4330-b807-4a5a0f022386 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:21.386884 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 65/127] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:21 2022] GET /identity/v3/users/c9c77caa8ec1422eb63723b3db112685 => generated 247 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:21.387826 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1f3c1-618c-4330-b807-4a5a0f022386 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:21.424163 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c9e8c-0647-41d5-953b-b7e0323ae3fe None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:21.462448 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35f200-7f1b-4422-aacf-962907d9499a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:21.463381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f200-7f1b-4422-aacf-962907d9499a None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:21.463731 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f200-7f1b-4422-aacf-962907d9499a None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:21.464094 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee35f200-7f1b-4422-aacf-962907d9499a None admin] PATH_INFO: `/v3/roles/member` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:21.476245 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee35f200-7f1b-4422-aacf-962907d9499a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:21.485482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-ee35f200-7f1b-4422-aacf-962907d9499a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:21.485482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:21.485482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:21.485482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:21.485482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:21.485482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:21.485482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:21.485482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:21.485482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:21.485482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:21.485482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:21.485482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:21.485482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:21.485482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:21.485482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:21.485482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:21.486381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:21.486381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:21.486381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:21.486381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:21.486381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:21.486381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:21.486381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:21.486381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:21.486381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:21.486381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:21.486381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:21.486381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:38:21.486381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:21.486381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:21.486381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:21.486381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:21.487174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:21.487174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:21.487174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:21.487174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:21.487174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:21.487174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:21.487174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:21.487174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:21.487174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:21.487174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:21.487174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:21.487174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:38:21.487174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 63/128] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:21.487907 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35f200-7f1b-4422-aacf-962907d9499a None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:21.524287 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b1f3c1-618c-4330-b807-4a5a0f022386 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:21.545996 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:21.573336 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e192e-b290-415d-ae64-e602bf5030c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:21.574804 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e192e-b290-415d-ae64-e602bf5030c1 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:21.575237 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e192e-b290-415d-ae64-e602bf5030c1 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:21.575656 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455e192e-b290-415d-ae64-e602bf5030c1 None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:21.578828 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e192e-b290-415d-ae64-e602bf5030c1 None admin] RBAC: Authorizing `identity:get_project(project_id=6daed429aa5449e2923488e535a6a243)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:21.580547 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455e192e-b290-415d-ae64-e602bf5030c1 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:21.587895 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 66/129] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:21 2022] GET /identity/v3/projects/6daed429aa5449e2923488e535a6a243 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:21.589354 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e192e-b290-415d-ae64-e602bf5030c1 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:21.625531 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee35f200-7f1b-4422-aacf-962907d9499a None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:21.672453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:21.677819 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d05b13-9ccc-4233-bcb5-13cc7c0408e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:21.678736 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d05b13-9ccc-4233-bcb5-13cc7c0408e6 None admin] REQUEST_METHOD: `PUT` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:21.679026 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d05b13-9ccc-4233-bcb5-13cc7c0408e6 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:21.679306 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d05b13-9ccc-4233-bcb5-13cc7c0408e6 None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243/users/f6c5e41e9bbe4c8e8a2622938ac4f876/roles/5614294f6ab949a99424ee6e983b6430` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:21.685526 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d05b13-9ccc-4233-bcb5-13cc7c0408e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=6daed429aa5449e2923488e535a6a243, user_id=f6c5e41e9bbe4c8e8a2622938ac4f876, role_id=5614294f6ab949a99424ee6e983b6430)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:21.688003 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d05b13-9ccc-4233-bcb5-13cc7c0408e6 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:21.713411 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455e192e-b290-415d-ae64-e602bf5030c1 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:21.755691 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cea6f-51f1-41bf-aa62-42d4415d90d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:21.756615 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cea6f-51f1-41bf-aa62-42d4415d90d9 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:21.756960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cea6f-51f1-41bf-aa62-42d4415d90d9 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:21.757346 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676cea6f-51f1-41bf-aa62-42d4415d90d9 None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:21.758717 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cea6f-51f1-41bf-aa62-42d4415d90d9 None admin] RBAC: Authorizing `identity:get_project(project_id=6daed429aa5449e2923488e535a6a243)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:21.760137 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676cea6f-51f1-41bf-aa62-42d4415d90d9 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:21.762082 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 67/130] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:21 2022] GET /identity/v3/projects/6daed429aa5449e2923488e535a6a243 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:21.767428 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cea6f-51f1-41bf-aa62-42d4415d90d9 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:21.768860 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 64/131] 10.222.0.62 () {58 vars in 1439 bytes} [Wed May 25 15:38:21 2022] PUT /identity/v3/projects/6daed429aa5449e2923488e535a6a243/users/f6c5e41e9bbe4c8e8a2622938ac4f876/roles/5614294f6ab949a99424ee6e983b6430 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:38:21.770386 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d05b13-9ccc-4233-bcb5-13cc7c0408e6 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:21.912256 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d05b13-9ccc-4233-bcb5-13cc7c0408e6 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:21.914702 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:21.959151 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41f226-f430-40e8-82df-66b1afb41456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:21.960660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41f226-f430-40e8-82df-66b1afb41456 None admin] REQUEST_METHOD: `PUT` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:21.961185 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41f226-f430-40e8-82df-66b1afb41456 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:21.961668 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb41f226-f430-40e8-82df-66b1afb41456 None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243/users/f6c5e41e9bbe4c8e8a2622938ac4f876/roles/abd8e1d1d7cd45cc93ed82f651c74d9b` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:21.964884 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41f226-f430-40e8-82df-66b1afb41456 None admin] RBAC: Authorizing `identity:create_grant(project_id=6daed429aa5449e2923488e535a6a243, user_id=f6c5e41e9bbe4c8e8a2622938ac4f876, role_id=abd8e1d1d7cd45cc93ed82f651c74d9b)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:21.967307 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb41f226-f430-40e8-82df-66b1afb41456 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:21.996189 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676cea6f-51f1-41bf-aa62-42d4415d90d9 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:22.046038 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf468d3-9179-476d-8e73-a5b482b7dc23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:22.047465 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf468d3-9179-476d-8e73-a5b482b7dc23 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:22.047909 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf468d3-9179-476d-8e73-a5b482b7dc23 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:22.048195 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf468d3-9179-476d-8e73-a5b482b7dc23 None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:22.049048 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf468d3-9179-476d-8e73-a5b482b7dc23 None admin] RBAC: Adding query filter params (name=member) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:22.049368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf468d3-9179-476d-8e73-a5b482b7dc23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:22.050764 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf468d3-9179-476d-8e73-a5b482b7dc23 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:22.053038 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:22.062667 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 68/132] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:22.063963 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf468d3-9179-476d-8e73-a5b482b7dc23 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:22.137426 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 65/133] 10.222.0.62 () {58 vars in 1439 bytes} [Wed May 25 15:38:21 2022] PUT /identity/v3/projects/6daed429aa5449e2923488e535a6a243/users/f6c5e41e9bbe4c8e8a2622938ac4f876/roles/abd8e1d1d7cd45cc93ed82f651c74d9b => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:38:22.138429 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41f226-f430-40e8-82df-66b1afb41456 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:22.251751 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf468d3-9179-476d-8e73-a5b482b7dc23 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:22.310463 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb41f226-f430-40e8-82df-66b1afb41456 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:22.338969 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431b57c3-eb11-4ade-93b5-edb218a3e448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:22.340352 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b57c3-eb11-4ade-93b5-edb218a3e448 None admin] REQUEST_METHOD: `PUT` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:22.340901 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b57c3-eb11-4ade-93b5-edb218a3e448 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:22.341412 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431b57c3-eb11-4ade-93b5-edb218a3e448 None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243/users/c9c77caa8ec1422eb63723b3db112685/roles/ae72bfdddd1e4a94a21a0d53264ee157` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:22.344176 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b57c3-eb11-4ade-93b5-edb218a3e448 None admin] RBAC: Authorizing `identity:create_grant(project_id=6daed429aa5449e2923488e535a6a243, user_id=c9c77caa8ec1422eb63723b3db112685, role_id=ae72bfdddd1e4a94a21a0d53264ee157)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:22.352447 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431b57c3-eb11-4ade-93b5-edb218a3e448 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:22.362248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6c543-1b73-4f2e-b9ea-ce26844488dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:22.363200 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6c543-1b73-4f2e-b9ea-ce26844488dc None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:22.363542 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6c543-1b73-4f2e-b9ea-ce26844488dc None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:22.363831 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6c543-1b73-4f2e-b9ea-ce26844488dc None admin] PATH_INFO: `/v3/users/f6c5e41e9bbe4c8e8a2622938ac4f876` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:22.365122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6c543-1b73-4f2e-b9ea-ce26844488dc None admin] RBAC: Authorizing `identity:get_user(user_id=f6c5e41e9bbe4c8e8a2622938ac4f876)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:22.366691 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6c543-1b73-4f2e-b9ea-ce26844488dc None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:22.369018 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 66/134] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:22 2022] GET /identity/v3/users/f6c5e41e9bbe4c8e8a2622938ac4f876 => generated 275 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:22.370544 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9dde5-e7c7-4d2d-bfe2-40791dd883a4 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:22.370837 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9dde5-e7c7-4d2d-bfe2-40791dd883a4 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:22.373325 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9dde5-e7c7-4d2d-bfe2-40791dd883a4 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:22.373325 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 67/135] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:22.377508 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9dde5-e7c7-4d2d-bfe2-40791dd883a4 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:22.416975 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:22.447889 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 69/136] 10.222.0.62 () {58 vars in 1439 bytes} [Wed May 25 15:38:22 2022] PUT /identity/v3/projects/6daed429aa5449e2923488e535a6a243/users/c9c77caa8ec1422eb63723b3db112685/roles/ae72bfdddd1e4a94a21a0d53264ee157 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:38:22.449592 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f1ce1-9c21-4ec7-9d8a-9a87eedfde9a None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:22.450137 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f1ce1-9c21-4ec7-9d8a-9a87eedfde9a None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:22.450614 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898f1ce1-9c21-4ec7-9d8a-9a87eedfde9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:22.487275 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-898f1ce1-9c21-4ec7-9d8a-9a87eedfde9a None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:22.488875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-898f1ce1-9c21-4ec7-9d8a-9a87eedfde9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:22.504838 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9dde5-e7c7-4d2d-bfe2-40791dd883a4 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:22.561880 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ac6da9-3709-4a41-8c96-a20146ca0061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:22.564653 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac6da9-3709-4a41-8c96-a20146ca0061 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:22.566203 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac6da9-3709-4a41-8c96-a20146ca0061 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:22.566525 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ac6da9-3709-4a41-8c96-a20146ca0061 None admin] PATH_INFO: `/v3/projects/caaffec5146d4d0da757c5eaff7dc451` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:22.569483 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac6da9-3709-4a41-8c96-a20146ca0061 None admin] RBAC: Authorizing `identity:get_project(project_id=caaffec5146d4d0da757c5eaff7dc451)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:22.574481 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ac6da9-3709-4a41-8c96-a20146ca0061 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:22.576476 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 68/137] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:22 2022] GET /identity/v3/projects/caaffec5146d4d0da757c5eaff7dc451 => generated 312 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:22.578055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecc648-cbdb-4168-b33b-924d00d15e7c None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:22.578350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecc648-cbdb-4168-b33b-924d00d15e7c None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:22.578632 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fecc648-cbdb-4168-b33b-924d00d15e7c None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:22.580042 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 69/138] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:22.584170 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:22.585939 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecc648-cbdb-4168-b33b-924d00d15e7c None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:22.605153 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 70/139] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:22.606844 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c15d78-4807-44c6-ab33-bb30870d25d7 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:22.612445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c15d78-4807-44c6-ab33-bb30870d25d7 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:22.612965 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c15d78-4807-44c6-ab33-bb30870d25d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:22.641486 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-86c15d78-4807-44c6-ab33-bb30870d25d7 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:22.642763 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-86c15d78-4807-44c6-ab33-bb30870d25d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:22.734321 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 71/140] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:22.735310 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c15d78-4807-44c6-ab33-bb30870d25d7 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:22.769222 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:22.776388 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fecc648-cbdb-4168-b33b-924d00d15e7c None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:22.824733 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425dde1a-4d5d-4127-be82-16de2f570b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:22.825750 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dde1a-4d5d-4127-be82-16de2f570b2d None admin] REQUEST_METHOD: `PUT` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:22.826047 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dde1a-4d5d-4127-be82-16de2f570b2d None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:22.826329 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425dde1a-4d5d-4127-be82-16de2f570b2d None admin] PATH_INFO: `/v3/projects/caaffec5146d4d0da757c5eaff7dc451/users/f6c5e41e9bbe4c8e8a2622938ac4f876/roles/5614294f6ab949a99424ee6e983b6430` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:22.828931 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425dde1a-4d5d-4127-be82-16de2f570b2d None admin] RBAC: Authorizing `identity:create_grant(project_id=caaffec5146d4d0da757c5eaff7dc451, user_id=f6c5e41e9bbe4c8e8a2622938ac4f876, role_id=5614294f6ab949a99424ee6e983b6430)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:22.830513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425dde1a-4d5d-4127-be82-16de2f570b2d None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:22.866921 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c15d78-4807-44c6-ab33-bb30870d25d7 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:22.886412 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:22.907236 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6135272-4eb4-45b3-90e3-3746df46790a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:22.908064 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6135272-4eb4-45b3-90e3-3746df46790a None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:22.908350 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6135272-4eb4-45b3-90e3-3746df46790a None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:22.908660 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6135272-4eb4-45b3-90e3-3746df46790a None admin] PATH_INFO: `/v3/domains/default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:22.909994 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6135272-4eb4-45b3-90e3-3746df46790a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:22.911484 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6135272-4eb4-45b3-90e3-3746df46790a None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:22.913349 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 72/141] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:38:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:22.913977 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6135272-4eb4-45b3-90e3-3746df46790a None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:22.938684 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 70/142] 10.222.0.62 () {58 vars in 1439 bytes} [Wed May 25 15:38:22 2022] PUT /identity/v3/projects/caaffec5146d4d0da757c5eaff7dc451/users/f6c5e41e9bbe4c8e8a2622938ac4f876/roles/5614294f6ab949a99424ee6e983b6430 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:38:22.940408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425dde1a-4d5d-4127-be82-16de2f570b2d None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:23.035814 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6135272-4eb4-45b3-90e3-3746df46790a None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:23.078657 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc82a4-837f-49c3-a3f7-4241a2a2dbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:23.080476 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc82a4-837f-49c3-a3f7-4241a2a2dbae None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:23.081340 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc82a4-837f-49c3-a3f7-4241a2a2dbae None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:23.081626 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fc82a4-837f-49c3-a3f7-4241a2a2dbae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:23.106459 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fc82a4-837f-49c3-a3f7-4241a2a2dbae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:23.115046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-11fc82a4-837f-49c3-a3f7-4241a2a2dbae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:38:23.115046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:23.115046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:23.115046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:23.115046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:23.115046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:23.115046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:23.115046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:23.115046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:23.115046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:23.115046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:23.115046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:23.115046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:23.115046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:23.115046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:23.115046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:23.116000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:23.116000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:23.116000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:23.116000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:23.116000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:23.116000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:23.116000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:23.116000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:23.116000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:23.116000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:23.116000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:23.116000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:23.116000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:23.116000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:23.116000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:23.116000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:23.116802 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:23.116802 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:23.116802 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:23.116802 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:23.116802 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:23.116802 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:23.116802 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:23.116802 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:23.116802 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:23.116802 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:23.116802 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:38:23.116802 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:23.116802 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 73/143] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:23.127748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc82a4-837f-49c3-a3f7-4241a2a2dbae None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:23.173922 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425dde1a-4d5d-4127-be82-16de2f570b2d None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:23.209933 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:23.239585 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b268fc-ad81-4c98-9192-ff075b3626f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:23.240288 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b268fc-ad81-4c98-9192-ff075b3626f5 None admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:23.251480 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b268fc-ad81-4c98-9192-ff075b3626f5 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:23.251480 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b268fc-ad81-4c98-9192-ff075b3626f5 None admin] PATH_INFO: `/v3/users` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:23.251480 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b268fc-ad81-4c98-9192-ff075b3626f5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:23.251480 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b268fc-ad81-4c98-9192-ff075b3626f5 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:23.259746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fc82a4-837f-49c3-a3f7-4241a2a2dbae None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:23.303450 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9db430-c45b-41da-aafd-0dff792d7b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:23.304155 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9db430-c45b-41da-aafd-0dff792d7b3b None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:23.304473 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9db430-c45b-41da-aafd-0dff792d7b3b None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:23.304763 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9db430-c45b-41da-aafd-0dff792d7b3b None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:23.305593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9db430-c45b-41da-aafd-0dff792d7b3b None admin] RBAC: Adding query filter params (name=reader) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:23.315079 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9db430-c45b-41da-aafd-0dff792d7b3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:23.315079 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9db430-c45b-41da-aafd-0dff792d7b3b None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:23.318872 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 74/144] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:23.328712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9db430-c45b-41da-aafd-0dff792d7b3b None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:23.384891 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 71/145] 10.222.0.62 () {60 vars in 1132 bytes} [Wed May 25 15:38:22 2022] POST /identity/v3/users => generated 283 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:38:23.494039 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9db430-c45b-41da-aafd-0dff792d7b3b None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:23.501963 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:23.547015 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b29410-b8b8-443f-bb9e-7e3fbc8341de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:23.548041 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b29410-b8b8-443f-bb9e-7e3fbc8341de None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:23.548434 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b29410-b8b8-443f-bb9e-7e3fbc8341de None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:23.548757 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b29410-b8b8-443f-bb9e-7e3fbc8341de None admin] PATH_INFO: `/v3/users/bddc0a7e1d2d459ab04416e4c32f15a7` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:23.553652 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b29410-b8b8-443f-bb9e-7e3fbc8341de None admin] RBAC: Authorizing `identity:get_user(user_id=bddc0a7e1d2d459ab04416e4c32f15a7)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:23.555195 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b29410-b8b8-443f-bb9e-7e3fbc8341de None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:23.557678 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 75/146] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:23 2022] GET /identity/v3/users/bddc0a7e1d2d459ab04416e4c32f15a7 => generated 289 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:23.564506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b268fc-ad81-4c98-9192-ff075b3626f5 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:23.595247 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:23.746114 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b268fc-ad81-4c98-9192-ff075b3626f5 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:23.818336 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca8705-d540-4394-a722-ad6aa6f8466f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:23.819649 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca8705-d540-4394-a722-ad6aa6f8466f None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:23.820118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca8705-d540-4394-a722-ad6aa6f8466f None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:23.820623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca8705-d540-4394-a722-ad6aa6f8466f None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:23.822691 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca8705-d540-4394-a722-ad6aa6f8466f None admin] RBAC: Authorizing `identity:get_project(project_id=6daed429aa5449e2923488e535a6a243)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:23.825343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca8705-d540-4394-a722-ad6aa6f8466f None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:23.828520 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 72/147] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:23 2022] GET /identity/v3/projects/6daed429aa5449e2923488e535a6a243 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:23.837598 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b29410-b8b8-443f-bb9e-7e3fbc8341de None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:23.986864 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b29410-b8b8-443f-bb9e-7e3fbc8341de None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:24.032582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6964e3-ea55-48a8-9a4f-c70b343e4bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:24.033512 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6964e3-ea55-48a8-9a4f-c70b343e4bc4 None admin] REQUEST_METHOD: `PUT` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:24.033792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6964e3-ea55-48a8-9a4f-c70b343e4bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:24.034067 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6964e3-ea55-48a8-9a4f-c70b343e4bc4 None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243/users/bddc0a7e1d2d459ab04416e4c32f15a7/roles/29ddb77b56f449aa87fa909f2eebe434` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:24.036202 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6964e3-ea55-48a8-9a4f-c70b343e4bc4 None admin] RBAC: Authorizing `identity:create_grant(project_id=6daed429aa5449e2923488e535a6a243, user_id=bddc0a7e1d2d459ab04416e4c32f15a7, role_id=29ddb77b56f449aa87fa909f2eebe434)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:24.037825 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6964e3-ea55-48a8-9a4f-c70b343e4bc4 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:24.150657 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 76/148] 10.222.0.62 () {58 vars in 1439 bytes} [Wed May 25 15:38:23 2022] PUT /identity/v3/projects/6daed429aa5449e2923488e535a6a243/users/bddc0a7e1d2d459ab04416e4c32f15a7/roles/29ddb77b56f449aa87fa909f2eebe434 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:38:25.545605 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811d176-73f4-4850-88cc-326818e28289 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:25.546138 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811d176-73f4-4850-88cc-326818e28289 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:25.546138 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f811d176-73f4-4850-88cc-326818e28289 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:25.548785 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 73/149] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:25.566742 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23245478-009a-44e1-b5e9-551469851d6a None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:25.567275 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23245478-009a-44e1-b5e9-551469851d6a None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:25.567275 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23245478-009a-44e1-b5e9-551469851d6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:25.590005 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-23245478-009a-44e1-b5e9-551469851d6a None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:25.590855 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-23245478-009a-44e1-b5e9-551469851d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:25.628314 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:25.681194 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 77/150] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:25.733954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811d176-73f4-4850-88cc-326818e28289 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:25.836457 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:25.857615 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f811d176-73f4-4850-88cc-326818e28289 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:25.870390 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4e9c7-dac1-40ce-8407-248af9a0a66a None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:25.870707 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4e9c7-dac1-40ce-8407-248af9a0a66a None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:25.870941 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad4e9c7-dac1-40ce-8407-248af9a0a66a None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:25.872585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 78/151] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:25.882742 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b17ff9-a36b-4231-b513-e2acc08ff5c1 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:25.883031 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b17ff9-a36b-4231-b513-e2acc08ff5c1 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:25.883353 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b17ff9-a36b-4231-b513-e2acc08ff5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:25.909507 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-b4b17ff9-a36b-4231-b513-e2acc08ff5c1 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:25.910758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-b4b17ff9-a36b-4231-b513-e2acc08ff5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:25.937467 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632eb4f5-13c5-4c8e-a9d5-84dcb4e59b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:25.938294 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632eb4f5-13c5-4c8e-a9d5-84dcb4e59b5a None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:25.938594 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632eb4f5-13c5-4c8e-a9d5-84dcb4e59b5a None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:25.939035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632eb4f5-13c5-4c8e-a9d5-84dcb4e59b5a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:25.961289 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632eb4f5-13c5-4c8e-a9d5-84dcb4e59b5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:25.976350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-632eb4f5-13c5-4c8e-a9d5-84dcb4e59b5a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:38:25.976350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:25.976350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:25.976350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:25.976350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:25.976350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:25.976350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:25.976350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:25.976350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:25.976350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:25.976350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:25.976350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:25.976350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:25.976350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:25.976350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:25.976350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:25.977469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:25.977469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:25.977469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:25.977469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:25.977469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:25.977469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:25.977469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:25.977469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:25.977469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:25.977469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:25.977469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:25.977469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:38:25.977469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:25.977469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:25.977469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:25.977469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:25.978512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:25.978512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:25.978512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:25.978512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:25.978512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:25.978512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:25.978512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:25.978512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:25.978512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:25.978512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:25.978512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:38:25.978512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:38:25.981678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 74/152] 10.222.0.62 () {56 vars in 1114 bytes} [Wed May 25 15:38:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:25.988899 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632eb4f5-13c5-4c8e-a9d5-84dcb4e59b5a None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:26.077280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 79/153] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:38:26.085529 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3c215-149d-41fe-91a2-248a11198f92 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:26.085822 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3c215-149d-41fe-91a2-248a11198f92 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:26.086105 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3c215-149d-41fe-91a2-248a11198f92 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:26.091961 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 80/154] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:26.094034 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac61c2-37f0-47ca-89d9-0a804d6eee29 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:26.094507 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac61c2-37f0-47ca-89d9-0a804d6eee29 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:26.094992 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac61c2-37f0-47ca-89d9-0a804d6eee29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:26.149685 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-29ac61c2-37f0-47ca-89d9-0a804d6eee29 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:26.150895 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-29ac61c2-37f0-47ca-89d9-0a804d6eee29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:26.222338 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632eb4f5-13c5-4c8e-a9d5-84dcb4e59b5a None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:26.299994 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 81/155] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:26.302550 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac61c2-37f0-47ca-89d9-0a804d6eee29 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:26.337777 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2641f95-8d59-4d26-8ee1-5649e0d5dad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:26.338765 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2641f95-8d59-4d26-8ee1-5649e0d5dad4 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:26.338941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2641f95-8d59-4d26-8ee1-5649e0d5dad4 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:26.339178 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2641f95-8d59-4d26-8ee1-5649e0d5dad4 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:26.339828 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2641f95-8d59-4d26-8ee1-5649e0d5dad4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:26.340134 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2641f95-8d59-4d26-8ee1-5649e0d5dad4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:26.345821 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2641f95-8d59-4d26-8ee1-5649e0d5dad4 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:26.352838 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:26.359502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 75/156] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:38:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:26.360693 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2641f95-8d59-4d26-8ee1-5649e0d5dad4 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:26.376818 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:26.461435 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac61c2-37f0-47ca-89d9-0a804d6eee29 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:26.539562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687ca34-9b13-4d3c-897d-185baf25a201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:26.542001 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687ca34-9b13-4d3c-897d-185baf25a201 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:26.542565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687ca34-9b13-4d3c-897d-185baf25a201 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:26.543024 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6687ca34-9b13-4d3c-897d-185baf25a201 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:26.571354 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6687ca34-9b13-4d3c-897d-185baf25a201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:26.591727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-6687ca34-9b13-4d3c-897d-185baf25a201 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:26.591727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:26.591727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:26.591727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:26.591727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:26.591727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:26.591727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:26.591727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:26.591727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:26.591727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:26.591727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:26.591727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:26.591727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:26.591727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:26.591727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:26.591727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:26.592806 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:26.592806 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:26.592806 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:26.592806 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:26.592806 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:26.592806 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:26.592806 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:26.592806 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:26.592806 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:26.592806 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:26.592806 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:26.592806 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:26.592806 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:26.592806 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:26.592806 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:26.592806 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:26.594005 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:26.594005 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:26.594005 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:26.594005 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:26.594005 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:26.594005 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:26.594005 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:26.594005 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:26.594005 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:26.594005 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:26.594005 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:26.594005 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:26.601548 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 82/157] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:26.603296 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687ca34-9b13-4d3c-897d-185baf25a201 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:26.619940 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2641f95-8d59-4d26-8ee1-5649e0d5dad4 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:26.700439 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fc2d0-bfd1-4650-b649-29eede0de6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:26.700439 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fc2d0-bfd1-4650-b649-29eede0de6e0 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:26.700439 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fc2d0-bfd1-4650-b649-29eede0de6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:26.700439 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9fc2d0-bfd1-4650-b649-29eede0de6e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:26.728480 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9fc2d0-bfd1-4650-b649-29eede0de6e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:26.740343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-be9fc2d0-bfd1-4650-b649-29eede0de6e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:38:26.740343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:26.740343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:26.740343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:26.740343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:26.740343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:26.740343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:26.740343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:26.740343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:26.740343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:26.740343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:26.740343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:26.740343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:26.740343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:26.740343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:26.740343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:26.741560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:26.741560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:26.741560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:26.741560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:26.741560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:26.741560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:26.741560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:26.741560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:26.741560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:26.741560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:26.741560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:26.741560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:38:26.741560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:26.741560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:26.741560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:26.741560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:26.742623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:26.742623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:26.742623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:26.742623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:26.742623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:26.742623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:26.742623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:26.742623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:26.742623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:26.742623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:26.742623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:38:26.742623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:38:26.742623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 76/158] 10.222.0.62 () {56 vars in 1096 bytes} [Wed May 25 15:38:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:26.742623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fc2d0-bfd1-4650-b649-29eede0de6e0 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:26.769895 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6687ca34-9b13-4d3c-897d-185baf25a201 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:26.779076 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:26.835603 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:26.842409 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cf6d2-d673-4085-b5f4-2e7c2b1202a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:26.844021 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cf6d2-d673-4085-b5f4-2e7c2b1202a3 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:26.844443 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cf6d2-d673-4085-b5f4-2e7c2b1202a3 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:26.844739 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5cf6d2-d673-4085-b5f4-2e7c2b1202a3 None admin] PATH_INFO: `/v3/users/f6c5e41e9bbe4c8e8a2622938ac4f876` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:26.847780 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cf6d2-d673-4085-b5f4-2e7c2b1202a3 None admin] RBAC: Authorizing `identity:get_user(user_id=f6c5e41e9bbe4c8e8a2622938ac4f876)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:26.849646 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5cf6d2-d673-4085-b5f4-2e7c2b1202a3 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:26.851535 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 83/159] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:26 2022] GET /identity/v3/users/f6c5e41e9bbe4c8e8a2622938ac4f876 => generated 275 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:26.852603 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cf6d2-d673-4085-b5f4-2e7c2b1202a3 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:26.902718 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9fc2d0-bfd1-4650-b649-29eede0de6e0 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:26.996945 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4979671-5932-4b19-87df-b131177a30fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:26.997744 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4979671-5932-4b19-87df-b131177a30fe None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:26.998217 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4979671-5932-4b19-87df-b131177a30fe None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:26.998581 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4979671-5932-4b19-87df-b131177a30fe None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:27.000069 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4979671-5932-4b19-87df-b131177a30fe None admin] RBAC: Adding query filter params (name=member) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:27.000570 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4979671-5932-4b19-87df-b131177a30fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:27.002053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4979671-5932-4b19-87df-b131177a30fe None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:27.013131 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 77/160] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:27.014104 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4979671-5932-4b19-87df-b131177a30fe None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:27.036505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5cf6d2-d673-4085-b5f4-2e7c2b1202a3 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:27.076974 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98d421-8089-4f82-be05-2eb42275793b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:27.078668 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98d421-8089-4f82-be05-2eb42275793b None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:27.078962 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98d421-8089-4f82-be05-2eb42275793b None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:27.079243 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98d421-8089-4f82-be05-2eb42275793b None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:27.080008 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98d421-8089-4f82-be05-2eb42275793b None admin] RBAC: Adding query filter params (name=admin) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:27.080315 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98d421-8089-4f82-be05-2eb42275793b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:27.082191 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd98d421-8089-4f82-be05-2eb42275793b None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:27.092444 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 84/161] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:27.094164 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98d421-8089-4f82-be05-2eb42275793b None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:27.112924 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:27.280099 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4979671-5932-4b19-87df-b131177a30fe None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:27.338729 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98d421-8089-4f82-be05-2eb42275793b None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:27.351903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:27.388008 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7114129-b5c2-4ed7-b096-8c705ce41bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:27.388626 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7114129-b5c2-4ed7-b096-8c705ce41bc3 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:27.388914 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7114129-b5c2-4ed7-b096-8c705ce41bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:27.389257 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7114129-b5c2-4ed7-b096-8c705ce41bc3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:27.449168 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cf47d1-a7a2-4cb6-8caa-dd87047c7e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:27.450079 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf47d1-a7a2-4cb6-8caa-dd87047c7e97 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:27.450347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf47d1-a7a2-4cb6-8caa-dd87047c7e97 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:27.450635 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cf47d1-a7a2-4cb6-8caa-dd87047c7e97 None admin] PATH_INFO: `/v3/users/f6c5e41e9bbe4c8e8a2622938ac4f876` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:27.451890 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf47d1-a7a2-4cb6-8caa-dd87047c7e97 None admin] RBAC: Authorizing `identity:get_user(user_id=f6c5e41e9bbe4c8e8a2622938ac4f876)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:27.454455 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cf47d1-a7a2-4cb6-8caa-dd87047c7e97 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:27.456144 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 85/162] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:27 2022] GET /identity/v3/users/f6c5e41e9bbe4c8e8a2622938ac4f876 => generated 275 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:27.461683 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4e18a-14d5-4f1b-82d9-8715b06df021 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:27.461973 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4e18a-14d5-4f1b-82d9-8715b06df021 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:27.462258 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c4e18a-14d5-4f1b-82d9-8715b06df021 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:27.463628 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 86/163] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:27.464368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4e18a-14d5-4f1b-82d9-8715b06df021 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:27.542230 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7114129-b5c2-4ed7-b096-8c705ce41bc3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:27.543751 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7114129-b5c2-4ed7-b096-8c705ce41bc3 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:27.604840 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:27.626582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c4e18a-14d5-4f1b-82d9-8715b06df021 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:27.721356 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758a8df-0051-4118-852f-f3af17a5faaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:27.722188 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758a8df-0051-4118-852f-f3af17a5faaa None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:27.722475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758a8df-0051-4118-852f-f3af17a5faaa None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:27.722753 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b758a8df-0051-4118-852f-f3af17a5faaa None admin] PATH_INFO: `/v3/users/c9c77caa8ec1422eb63723b3db112685` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:27.732942 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758a8df-0051-4118-852f-f3af17a5faaa None admin] RBAC: Authorizing `identity:get_user(user_id=c9c77caa8ec1422eb63723b3db112685)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:27.732942 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b758a8df-0051-4118-852f-f3af17a5faaa None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:27.732942 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 87/164] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:27 2022] GET /identity/v3/users/c9c77caa8ec1422eb63723b3db112685 => generated 247 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:27.734478 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758a8df-0051-4118-852f-f3af17a5faaa None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:27.745323 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 78/165] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:27.747509 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f5178-ed91-4b6c-b890-dd50b13f5926 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:27.748034 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f5178-ed91-4b6c-b890-dd50b13f5926 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:27.748570 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53f5178-ed91-4b6c-b890-dd50b13f5926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:27.784002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-f53f5178-ed91-4b6c-b890-dd50b13f5926 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:27.785288 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-f53f5178-ed91-4b6c-b890-dd50b13f5926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:27.811586 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:27.954937 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 79/166] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:27.955880 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f5178-ed91-4b6c-b890-dd50b13f5926 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:28.010898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b758a8df-0051-4118-852f-f3af17a5faaa None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:28.085748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8dfe33-8139-44ee-bf7d-f88d4f119c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:28.086420 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dfe33-8139-44ee-bf7d-f88d4f119c7a None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:28.086703 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dfe33-8139-44ee-bf7d-f88d4f119c7a None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:28.086975 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8dfe33-8139-44ee-bf7d-f88d4f119c7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:28.179121 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:28.226750 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53f5178-ed91-4b6c-b890-dd50b13f5926 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:28.287974 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8dfe33-8139-44ee-bf7d-f88d4f119c7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:28.290096 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8dfe33-8139-44ee-bf7d-f88d4f119c7a None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:28.305671 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992d646-91ff-451b-8647-d738b034d98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:28.306485 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992d646-91ff-451b-8647-d738b034d98c None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:28.306820 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992d646-91ff-451b-8647-d738b034d98c None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:28.307138 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0992d646-91ff-451b-8647-d738b034d98c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:28.362546 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:28.462496 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992d646-91ff-451b-8647-d738b034d98c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:28.464175 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0992d646-91ff-451b-8647-d738b034d98c None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:28.504055 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 88/167] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 770 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:28.505829 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8dfe33-8139-44ee-bf7d-f88d4f119c7a None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:28.566747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:28.604487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 80/168] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:28.604487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992d646-91ff-451b-8647-d738b034d98c None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:28.639476 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8dfe33-8139-44ee-bf7d-f88d4f119c7a None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:28.686377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:28.688473 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50296535-2abe-48a6-9f0c-b99c50db0cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:28.689653 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50296535-2abe-48a6-9f0c-b99c50db0cbf None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:28.689941 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50296535-2abe-48a6-9f0c-b99c50db0cbf None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:28.690224 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50296535-2abe-48a6-9f0c-b99c50db0cbf None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:28.692060 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50296535-2abe-48a6-9f0c-b99c50db0cbf None admin] RBAC: Authorizing `identity:get_project(project_id=6daed429aa5449e2923488e535a6a243)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:28.693341 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50296535-2abe-48a6-9f0c-b99c50db0cbf None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:28.695287 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 89/169] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:28 2022] GET /identity/v3/projects/6daed429aa5449e2923488e535a6a243 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:28.701387 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c6de9-8dd2-4e07-a417-44cbbc4309ff None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:28.701766 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c6de9-8dd2-4e07-a417-44cbbc4309ff None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:28.702055 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06c6de9-8dd2-4e07-a417-44cbbc4309ff None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:28.703794 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 90/170] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:28 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:28.705083 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25839af2-b219-49cd-9cf6-3f67f2b99b16 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:28.705475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25839af2-b219-49cd-9cf6-3f67f2b99b16 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:28.705764 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25839af2-b219-49cd-9cf6-3f67f2b99b16 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:28.707231 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 91/171] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:28.711539 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25839af2-b219-49cd-9cf6-3f67f2b99b16 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:28.750131 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0992d646-91ff-451b-8647-d738b034d98c None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:28.789447 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fb8d8-5fa4-46c9-b6b1-c12e8874fe77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:28.790331 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fb8d8-5fa4-46c9-b6b1-c12e8874fe77 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:28.790625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fb8d8-5fa4-46c9-b6b1-c12e8874fe77 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:28.790950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60fb8d8-5fa4-46c9-b6b1-c12e8874fe77 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:28.802905 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60fb8d8-5fa4-46c9-b6b1-c12e8874fe77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:28.811520 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-a60fb8d8-5fa4-46c9-b6b1-c12e8874fe77 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:28.811520 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:28.811520 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:28.811520 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:28.811520 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:28.811520 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:28.811520 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:28.811520 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:28.811520 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:28.811520 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:28.811520 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:28.811520 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:28.811520 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:28.811520 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:28.811520 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:28.811520 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:28.813399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:28.813399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:28.813399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:28.813399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:28.813399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:28.813399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:28.813399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:28.813399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:28.813399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:28.813399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:28.813399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:28.813399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:38:28.813399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:28.813399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:28.813399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:28.813399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:28.814181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:28.814181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:28.814181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:28.814181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:28.814181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:28.814181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:28.814181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:28.814181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:28.814181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:28.814181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:28.814181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:28.814181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:38:28.814181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 81/172] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:28.814819 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fb8d8-5fa4-46c9-b6b1-c12e8874fe77 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:28.853870 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25839af2-b219-49cd-9cf6-3f67f2b99b16 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:28.876162 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:28.900080 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caabab9-d488-4e1f-a759-d315a7b93610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:28.901314 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caabab9-d488-4e1f-a759-d315a7b93610 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:28.901605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caabab9-d488-4e1f-a759-d315a7b93610 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:28.902024 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caabab9-d488-4e1f-a759-d315a7b93610 None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:28.904551 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caabab9-d488-4e1f-a759-d315a7b93610 None admin] RBAC: Authorizing `identity:get_project(project_id=6daed429aa5449e2923488e535a6a243)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:28.906721 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caabab9-d488-4e1f-a759-d315a7b93610 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:28.914168 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 92/173] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:28 2022] GET /identity/v3/projects/6daed429aa5449e2923488e535a6a243 => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:28.914168 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caabab9-d488-4e1f-a759-d315a7b93610 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:28.975522 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60fb8d8-5fa4-46c9-b6b1-c12e8874fe77 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:28.994342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:29.014815 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8dafd6-9b39-48a8-b2cc-b5c48bc0f474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:29.015981 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dafd6-9b39-48a8-b2cc-b5c48bc0f474 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:29.016408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dafd6-9b39-48a8-b2cc-b5c48bc0f474 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:29.016845 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8dafd6-9b39-48a8-b2cc-b5c48bc0f474 None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:29.018314 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8dafd6-9b39-48a8-b2cc-b5c48bc0f474 None admin] RBAC: Authorizing `identity:get_project(project_id=6daed429aa5449e2923488e535a6a243)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:29.020222 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8dafd6-9b39-48a8-b2cc-b5c48bc0f474 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:29.027199 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 82/174] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:28 2022] GET /identity/v3/projects/6daed429aa5449e2923488e535a6a243 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:29.028845 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525639fc-0400-45e3-b6a2-d2362679f5c3 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:29.029281 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525639fc-0400-45e3-b6a2-d2362679f5c3 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:29.029770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525639fc-0400-45e3-b6a2-d2362679f5c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:29.041437 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caabab9-d488-4e1f-a759-d315a7b93610 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:29.048719 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-525639fc-0400-45e3-b6a2-d2362679f5c3 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:29.050154 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-525639fc-0400-45e3-b6a2-d2362679f5c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:29.085089 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64d1dd3-7645-4652-be29-5ba0dcbe36bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:29.086077 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d1dd3-7645-4652-be29-5ba0dcbe36bf None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:29.086466 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d1dd3-7645-4652-be29-5ba0dcbe36bf None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:29.087013 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64d1dd3-7645-4652-be29-5ba0dcbe36bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:29.088071 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d1dd3-7645-4652-be29-5ba0dcbe36bf None admin] RBAC: Adding query filter params (role.id=abd8e1d1d7cd45cc93ed82f651c74d9b, scope.project.id=6daed429aa5449e2923488e535a6a243, user.id=f6c5e41e9bbe4c8e8a2622938ac4f876) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:29.088596 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d1dd3-7645-4652-be29-5ba0dcbe36bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:29.090322 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64d1dd3-7645-4652-be29-5ba0dcbe36bf None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:29.097798 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 93/175] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:38:28 2022] GET /identity/v3/role_assignments?user.id=f6c5e41e9bbe4c8e8a2622938ac4f876&scope.project.id=6daed429aa5449e2923488e535a6a243&role.id=abd8e1d1d7cd45cc93ed82f651c74d9b => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:29.112530 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f719e40-b648-412b-be52-e73ee24fbe45 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:29.112942 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f719e40-b648-412b-be52-e73ee24fbe45 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:29.113689 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f719e40-b648-412b-be52-e73ee24fbe45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:29.135550 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 83/176] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:29.136757 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525639fc-0400-45e3-b6a2-d2362679f5c3 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:29.143101 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-6f719e40-b648-412b-be52-e73ee24fbe45 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:29.146367 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-6f719e40-b648-412b-be52-e73ee24fbe45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:29.210879 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:29.238162 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 94/177] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:29.239823 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f719e40-b648-412b-be52-e73ee24fbe45 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:29.287952 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525639fc-0400-45e3-b6a2-d2362679f5c3 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:29.316052 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:29.341984 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b782144-4c70-44d4-8b01-f53dd077f702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:29.342683 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b782144-4c70-44d4-8b01-f53dd077f702 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:29.342960 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b782144-4c70-44d4-8b01-f53dd077f702 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:29.343981 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b782144-4c70-44d4-8b01-f53dd077f702 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:29.344609 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b782144-4c70-44d4-8b01-f53dd077f702 None admin] RBAC: Adding query filter params (name=member) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:29.344865 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b782144-4c70-44d4-8b01-f53dd077f702 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:29.346259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b782144-4c70-44d4-8b01-f53dd077f702 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:29.357762 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 84/178] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:29.357762 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b782144-4c70-44d4-8b01-f53dd077f702 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:29.402087 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f719e40-b648-412b-be52-e73ee24fbe45 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:29.439952 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379902bd-45ac-449f-8628-20dbfea7d93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:29.440666 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379902bd-45ac-449f-8628-20dbfea7d93e None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:29.440981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379902bd-45ac-449f-8628-20dbfea7d93e None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:29.441285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379902bd-45ac-449f-8628-20dbfea7d93e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:29.442144 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379902bd-45ac-449f-8628-20dbfea7d93e None admin] RBAC: Adding query filter params (role.id=5614294f6ab949a99424ee6e983b6430, scope.project.id=6daed429aa5449e2923488e535a6a243, user.id=f6c5e41e9bbe4c8e8a2622938ac4f876) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:29.442454 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379902bd-45ac-449f-8628-20dbfea7d93e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:29.443917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379902bd-45ac-449f-8628-20dbfea7d93e None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:29.450806 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 95/179] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:38:29 2022] GET /identity/v3/role_assignments?user.id=f6c5e41e9bbe4c8e8a2622938ac4f876&scope.project.id=6daed429aa5449e2923488e535a6a243&role.id=5614294f6ab949a99424ee6e983b6430 => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:29.452214 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60e37d-7210-4ca4-a92c-fd657beefc45 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:29.452750 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60e37d-7210-4ca4-a92c-fd657beefc45 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:29.453571 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a60e37d-7210-4ca4-a92c-fd657beefc45 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:29.459655 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 96/180] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:29.459655 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638025fd-081f-49f1-8828-f5502b3af618 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:29.459655 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638025fd-081f-49f1-8828-f5502b3af618 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:29.459655 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638025fd-081f-49f1-8828-f5502b3af618 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:29.459655 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 97/181] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:29.462880 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638025fd-081f-49f1-8828-f5502b3af618 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:29.486347 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b782144-4c70-44d4-8b01-f53dd077f702 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:29.525197 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b03abf-840e-4893-a654-a46e72e5ea9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:29.525874 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b03abf-840e-4893-a654-a46e72e5ea9c None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:29.526159 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b03abf-840e-4893-a654-a46e72e5ea9c None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:29.526416 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:29.526547 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b03abf-840e-4893-a654-a46e72e5ea9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:29.527506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b03abf-840e-4893-a654-a46e72e5ea9c None admin] RBAC: Adding query filter params (role.id=ae72bfdddd1e4a94a21a0d53264ee157, scope.project.id=6daed429aa5449e2923488e535a6a243, user.id=c9c77caa8ec1422eb63723b3db112685) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:29.527613 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b03abf-840e-4893-a654-a46e72e5ea9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:29.529065 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b03abf-840e-4893-a654-a46e72e5ea9c None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:29.536782 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 85/182] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:38:29 2022] GET /identity/v3/role_assignments?user.id=c9c77caa8ec1422eb63723b3db112685&scope.project.id=6daed429aa5449e2923488e535a6a243&role.id=ae72bfdddd1e4a94a21a0d53264ee157 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:29.537659 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b03abf-840e-4893-a654-a46e72e5ea9c None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:29.616484 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638025fd-081f-49f1-8828-f5502b3af618 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:29.617826 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:29.684736 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1644e16-4c87-40b0-a8be-0ec8c460e63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:29.686274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1644e16-4c87-40b0-a8be-0ec8c460e63b None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:29.686588 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1644e16-4c87-40b0-a8be-0ec8c460e63b None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:29.686825 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1644e16-4c87-40b0-a8be-0ec8c460e63b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:29.704552 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1644e16-4c87-40b0-a8be-0ec8c460e63b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:29.713722 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-d1644e16-4c87-40b0-a8be-0ec8c460e63b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:38:29.713722 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:29.713722 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:29.713722 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:29.713722 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:29.713722 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:29.713722 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:29.713722 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:29.713722 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:29.713722 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:29.713722 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:29.713722 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:29.713722 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:29.713722 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:29.713722 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:29.713722 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:29.714680 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:29.714680 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:29.714680 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:29.714680 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:29.714680 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:29.714680 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:29.714680 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:29.714680 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:29.714680 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:29.714680 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:29.714680 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:29.714680 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:29.714680 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:29.714680 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:29.714680 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:29.714680 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:29.715581 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:29.715581 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:29.715581 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:29.715581 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:29.715581 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:29.715581 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:29.715581 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:29.715581 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:29.715581 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:29.715581 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:29.715581 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:38:29.715581 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:29.717882 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 98/183] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:29.720193 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1644e16-4c87-40b0-a8be-0ec8c460e63b None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:29.739798 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b03abf-840e-4893-a654-a46e72e5ea9c None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:29.790106 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cddc85-6cce-4e1c-a8c8-c330fcb4e712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:29.790942 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cddc85-6cce-4e1c-a8c8-c330fcb4e712 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:29.791300 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cddc85-6cce-4e1c-a8c8-c330fcb4e712 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:29.791581 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cddc85-6cce-4e1c-a8c8-c330fcb4e712 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:29.809651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cddc85-6cce-4e1c-a8c8-c330fcb4e712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:29.819157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-17cddc85-6cce-4e1c-a8c8-c330fcb4e712 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:38:29.819157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:29.819157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:29.819157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:29.819157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:29.819157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:29.819157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:29.819157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:29.819157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:29.819157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:29.819157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:29.819157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:29.819157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:29.819157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:29.819157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:29.819157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:29.820213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:29.820213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:29.820213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:29.820213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:29.820213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:29.820213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:29.820213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:29.820213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:29.820213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:29.820213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:29.820213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:29.820213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:38:29.820213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:29.820213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:29.820213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:29.820213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:29.821194 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:29.821194 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:29.821194 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:29.821194 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:29.821194 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:29.821194 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:29.821194 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:29.821194 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:29.821194 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:29.821194 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:29.821194 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:38:29.821194 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:38:29.821194 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 86/184] 10.222.0.62 () {56 vars in 1096 bytes} [Wed May 25 15:38:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:29.822102 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448e090-f646-4473-8527-d4651be7df6d None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:29.822401 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448e090-f646-4473-8527-d4651be7df6d None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:29.824069 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448e090-f646-4473-8527-d4651be7df6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:29.843332 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-f448e090-f646-4473-8527-d4651be7df6d None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:29.844712 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-f448e090-f646-4473-8527-d4651be7df6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:29.867978 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1644e16-4c87-40b0-a8be-0ec8c460e63b None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:29.870581 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:29.903831 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8ef1c1-dc00-4d9d-81b4-eccdbd64d57a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:29.904882 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ef1c1-dc00-4d9d-81b4-eccdbd64d57a None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:29.905168 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ef1c1-dc00-4d9d-81b4-eccdbd64d57a None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:29.905441 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8ef1c1-dc00-4d9d-81b4-eccdbd64d57a None admin] PATH_INFO: `/v3/users/f6c5e41e9bbe4c8e8a2622938ac4f876` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:29.906911 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ef1c1-dc00-4d9d-81b4-eccdbd64d57a None admin] RBAC: Authorizing `identity:get_user(user_id=f6c5e41e9bbe4c8e8a2622938ac4f876)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:29.908557 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8ef1c1-dc00-4d9d-81b4-eccdbd64d57a None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:29.910288 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 99/185] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:29 2022] GET /identity/v3/users/f6c5e41e9bbe4c8e8a2622938ac4f876 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:29.911530 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7397d-2cc5-4991-8e8a-b1d7ad5144ed None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:29.911928 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7397d-2cc5-4991-8e8a-b1d7ad5144ed None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:29.912207 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef7397d-2cc5-4991-8e8a-b1d7ad5144ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:29.922101 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 87/186] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:29.923476 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448e090-f646-4473-8527-d4651be7df6d None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:29.936519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-fef7397d-2cc5-4991-8e8a-b1d7ad5144ed None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:29.938729 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-fef7397d-2cc5-4991-8e8a-b1d7ad5144ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:29.961357 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:30.010888 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 100/187] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:30.016989 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7397d-2cc5-4991-8e8a-b1d7ad5144ed None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:30.036307 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448e090-f646-4473-8527-d4651be7df6d None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:30.072877 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65b92e-2f5a-4bc0-a491-b1d2ec779315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:30.073559 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65b92e-2f5a-4bc0-a491-b1d2ec779315 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:30.073847 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65b92e-2f5a-4bc0-a491-b1d2ec779315 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:30.074131 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65b92e-2f5a-4bc0-a491-b1d2ec779315 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:30.074887 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65b92e-2f5a-4bc0-a491-b1d2ec779315 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:30.075202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65b92e-2f5a-4bc0-a491-b1d2ec779315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:30.076623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65b92e-2f5a-4bc0-a491-b1d2ec779315 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:30.085266 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 88/188] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:30.086097 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65b92e-2f5a-4bc0-a491-b1d2ec779315 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:30.130174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef7397d-2cc5-4991-8e8a-b1d7ad5144ed None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:30.131734 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:30.166319 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a32616-b5ce-4154-819e-70f02e92fb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:30.166996 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a32616-b5ce-4154-819e-70f02e92fb9c None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:30.167281 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a32616-b5ce-4154-819e-70f02e92fb9c None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:30.167560 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a32616-b5ce-4154-819e-70f02e92fb9c None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:30.168316 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a32616-b5ce-4154-819e-70f02e92fb9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:30.168657 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a32616-b5ce-4154-819e-70f02e92fb9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:30.170050 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a32616-b5ce-4154-819e-70f02e92fb9c None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:30.179000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 101/189] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:30.181812 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a32616-b5ce-4154-819e-70f02e92fb9c None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:30.185038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:30.194931 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65b92e-2f5a-4bc0-a491-b1d2ec779315 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:30.230751 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7875b99-3bb3-45e3-b307-145a1b403dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:30.231411 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7875b99-3bb3-45e3-b307-145a1b403dbc None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:30.231697 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7875b99-3bb3-45e3-b307-145a1b403dbc None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:30.231978 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7875b99-3bb3-45e3-b307-145a1b403dbc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:30.286198 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a32616-b5ce-4154-819e-70f02e92fb9c None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:30.303680 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7875b99-3bb3-45e3-b307-145a1b403dbc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:30.305240 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7875b99-3bb3-45e3-b307-145a1b403dbc None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:30.320345 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d72230-494e-4540-8863-f9ea5b938fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:30.321182 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d72230-494e-4540-8863-f9ea5b938fe0 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:30.321467 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d72230-494e-4540-8863-f9ea5b938fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:30.321740 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d72230-494e-4540-8863-f9ea5b938fe0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:30.332363 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d72230-494e-4540-8863-f9ea5b938fe0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:30.340582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-00d72230-494e-4540-8863-f9ea5b938fe0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:38:30.340582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:30.340582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:30.340582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:30.340582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:30.340582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:30.340582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:30.340582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:30.340582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:30.340582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:30.340582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:30.340582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:30.340582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:30.340582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:30.340582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:30.340582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:30.341664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:30.341664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:30.341664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:30.341664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:30.341664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:30.341664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:30.341664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:30.341664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:30.341664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:30.341664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:30.341664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:30.341664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:30.341664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:30.341664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:30.341664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:30.341664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:30.348004 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:30.348004 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:30.348004 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:30.348004 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:30.348004 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:30.348004 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:30.348004 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:30.348004 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:30.348004 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:30.348004 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:30.348004 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:38:30.348004 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:30.348004 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 102/190] 10.222.0.62 () {56 vars in 1114 bytes} [Wed May 25 15:38:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:30.348004 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d72230-494e-4540-8863-f9ea5b938fe0 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:30.370980 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:30.402083 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:30.412628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 89/191] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:30.412628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7875b99-3bb3-45e3-b307-145a1b403dbc None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:30.451986 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d72230-494e-4540-8863-f9ea5b938fe0 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:30.486789 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e958c4b-a4b0-4ee8-8ca7-25376cc5c620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:30.487581 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e958c4b-a4b0-4ee8-8ca7-25376cc5c620 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:30.487860 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e958c4b-a4b0-4ee8-8ca7-25376cc5c620 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:30.488132 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e958c4b-a4b0-4ee8-8ca7-25376cc5c620 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:30.489332 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e958c4b-a4b0-4ee8-8ca7-25376cc5c620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:30.490777 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e958c4b-a4b0-4ee8-8ca7-25376cc5c620 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:30.492666 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 103/192] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:38:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:30.493258 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e958c4b-a4b0-4ee8-8ca7-25376cc5c620 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:30.514680 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7875b99-3bb3-45e3-b307-145a1b403dbc None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:30.551846 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4eb3cf-c75d-4e26-adc6-68ce7ee994cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:30.552743 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4eb3cf-c75d-4e26-adc6-68ce7ee994cf None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:30.553031 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4eb3cf-c75d-4e26-adc6-68ce7ee994cf None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:30.553305 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4eb3cf-c75d-4e26-adc6-68ce7ee994cf None admin] PATH_INFO: `/v3/users/bddc0a7e1d2d459ab04416e4c32f15a7` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:30.554491 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4eb3cf-c75d-4e26-adc6-68ce7ee994cf None admin] RBAC: Authorizing `identity:get_user(user_id=bddc0a7e1d2d459ab04416e4c32f15a7)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:30.555998 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4eb3cf-c75d-4e26-adc6-68ce7ee994cf None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:30.557665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 90/193] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:30 2022] GET /identity/v3/users/bddc0a7e1d2d459ab04416e4c32f15a7 => generated 289 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:30.558435 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4eb3cf-c75d-4e26-adc6-68ce7ee994cf None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:30.592685 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:30.602752 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e958c4b-a4b0-4ee8-8ca7-25376cc5c620 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:30.623335 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:30.636398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c73e7e-8657-4c79-b74f-74b25cad830d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:30.637362 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c73e7e-8657-4c79-b74f-74b25cad830d None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:30.637641 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c73e7e-8657-4c79-b74f-74b25cad830d None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:30.637916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c73e7e-8657-4c79-b74f-74b25cad830d None admin] PATH_INFO: `/v3/users/f1c0ce5efc994a6885d6a36dce16cbdf` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:30.653616 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c73e7e-8657-4c79-b74f-74b25cad830d None admin] RBAC: Authorizing `identity:get_user(user_id=f1c0ce5efc994a6885d6a36dce16cbdf)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:30.655121 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c73e7e-8657-4c79-b74f-74b25cad830d None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:30.657497 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 104/194] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:30 2022] GET /identity/v3/users/f1c0ce5efc994a6885d6a36dce16cbdf => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:30.658342 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c73e7e-8657-4c79-b74f-74b25cad830d None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:30.676300 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4eb3cf-c75d-4e26-adc6-68ce7ee994cf None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:30.713030 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2d76b-77a5-4107-9d23-d03c9c124d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:30.713938 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2d76b-77a5-4107-9d23-d03c9c124d18 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:30.713938 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2d76b-77a5-4107-9d23-d03c9c124d18 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:30.714178 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2d76b-77a5-4107-9d23-d03c9c124d18 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:30.714935 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2d76b-77a5-4107-9d23-d03c9c124d18 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:30.715249 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2d76b-77a5-4107-9d23-d03c9c124d18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:30.716665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2d76b-77a5-4107-9d23-d03c9c124d18 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:30.726073 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 91/195] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:38:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:30.730038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2d76b-77a5-4107-9d23-d03c9c124d18 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:30.763816 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c73e7e-8657-4c79-b74f-74b25cad830d None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:30.800537 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e938a-3f77-416f-a09c-99caf12dd90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:30.801406 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e938a-3f77-416f-a09c-99caf12dd90f None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:30.801685 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e938a-3f77-416f-a09c-99caf12dd90f None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:30.801955 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e938a-3f77-416f-a09c-99caf12dd90f None admin] PATH_INFO: `/v3/projects/caaffec5146d4d0da757c5eaff7dc451` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:30.803152 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e938a-3f77-416f-a09c-99caf12dd90f None admin] RBAC: Authorizing `identity:get_project(project_id=caaffec5146d4d0da757c5eaff7dc451)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:30.804655 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e938a-3f77-416f-a09c-99caf12dd90f None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:30.806365 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 105/196] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:30 2022] GET /identity/v3/projects/caaffec5146d4d0da757c5eaff7dc451 => generated 312 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:30.807168 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e938a-3f77-416f-a09c-99caf12dd90f None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:30.829568 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:30.835733 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2d76b-77a5-4107-9d23-d03c9c124d18 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:30.859302 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:30.871338 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3c470-20de-44b5-886a-f301ed289a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:30.871843 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3c470-20de-44b5-886a-f301ed289a98 None admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:30.872128 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3c470-20de-44b5-886a-f301ed289a98 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:30.872401 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3c470-20de-44b5-886a-f301ed289a98 None admin] PATH_INFO: `/v3/users` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:30.873137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3c470-20de-44b5-886a-f301ed289a98 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:30.875216 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3c470-20de-44b5-886a-f301ed289a98 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:30.911735 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e938a-3f77-416f-a09c-99caf12dd90f None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:30.945981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fab781-1d63-4ff0-a7c3-fb1aa570959b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:30.946637 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fab781-1d63-4ff0-a7c3-fb1aa570959b None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:30.946921 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fab781-1d63-4ff0-a7c3-fb1aa570959b None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:30.947196 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fab781-1d63-4ff0-a7c3-fb1aa570959b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:30.989304 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 92/197] 10.222.0.62 () {60 vars in 1132 bytes} [Wed May 25 15:38:30 2022] POST /identity/v3/users => generated 297 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:38:30.990321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3c470-20de-44b5-886a-f301ed289a98 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:31.034515 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fab781-1d63-4ff0-a7c3-fb1aa570959b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:31.036529 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fab781-1d63-4ff0-a7c3-fb1aa570959b None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:31.057554 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:31.143224 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3c470-20de-44b5-886a-f301ed289a98 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:31.159475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 106/198] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:31.160625 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fab781-1d63-4ff0-a7c3-fb1aa570959b None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:31.190802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bb57e-e905-46f0-a4b7-3f1598a6fe8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:31.191487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bb57e-e905-46f0-a4b7-3f1598a6fe8e None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:31.191769 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bb57e-e905-46f0-a4b7-3f1598a6fe8e None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:31.192048 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455bb57e-e905-46f0-a4b7-3f1598a6fe8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:31.256498 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:31.282754 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bb57e-e905-46f0-a4b7-3f1598a6fe8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:31.284287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455bb57e-e905-46f0-a4b7-3f1598a6fe8e None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:31.310268 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fab781-1d63-4ff0-a7c3-fb1aa570959b None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:31.333361 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:31.355562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d38e4-aedc-407a-bf5e-5ad20bd72a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:31.357036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d38e4-aedc-407a-bf5e-5ad20bd72a16 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:31.357821 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d38e4-aedc-407a-bf5e-5ad20bd72a16 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:31.358160 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d38e4-aedc-407a-bf5e-5ad20bd72a16 None admin] PATH_INFO: `/v3/users/f1c0ce5efc994a6885d6a36dce16cbdf` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:31.360810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d38e4-aedc-407a-bf5e-5ad20bd72a16 None admin] RBAC: Authorizing `identity:get_user(user_id=f1c0ce5efc994a6885d6a36dce16cbdf)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:31.368564 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d38e4-aedc-407a-bf5e-5ad20bd72a16 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:31.368564 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 107/199] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:31 2022] GET /identity/v3/users/f1c0ce5efc994a6885d6a36dce16cbdf => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:31.368564 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d38e4-aedc-407a-bf5e-5ad20bd72a16 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:31.423973 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 93/200] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:31.424894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bb57e-e905-46f0-a4b7-3f1598a6fe8e None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:31.490762 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d38e4-aedc-407a-bf5e-5ad20bd72a16 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:31.537727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6320c11-541e-4e81-9f40-a89f36be775e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:31.538805 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6320c11-541e-4e81-9f40-a89f36be775e None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:31.539309 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6320c11-541e-4e81-9f40-a89f36be775e None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:31.539785 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6320c11-541e-4e81-9f40-a89f36be775e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:31.541017 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6320c11-541e-4e81-9f40-a89f36be775e None admin] RBAC: Adding query filter params (role.id=5614294f6ab949a99424ee6e983b6430, scope.project.id=caaffec5146d4d0da757c5eaff7dc451, user.id=f6c5e41e9bbe4c8e8a2622938ac4f876) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:31.541547 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6320c11-541e-4e81-9f40-a89f36be775e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:31.542014 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:31.543434 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6320c11-541e-4e81-9f40-a89f36be775e None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:31.556533 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 108/201] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:38:31 2022] GET /identity/v3/role_assignments?user.id=f6c5e41e9bbe4c8e8a2622938ac4f876&scope.project.id=caaffec5146d4d0da757c5eaff7dc451&role.id=5614294f6ab949a99424ee6e983b6430 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:31.557945 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6320c11-541e-4e81-9f40-a89f36be775e None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:31.585899 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455bb57e-e905-46f0-a4b7-3f1598a6fe8e None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:31.651184 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:31.653081 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cab931-a464-4533-b179-cabb1181ad43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:31.653971 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cab931-a464-4533-b179-cabb1181ad43 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:31.654256 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cab931-a464-4533-b179-cabb1181ad43 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:31.654624 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cab931-a464-4533-b179-cabb1181ad43 None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:31.656261 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cab931-a464-4533-b179-cabb1181ad43 None admin] RBAC: Authorizing `identity:get_project(project_id=6daed429aa5449e2923488e535a6a243)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:31.657955 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41cab931-a464-4533-b179-cabb1181ad43 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:31.668929 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 94/202] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:31 2022] GET /identity/v3/projects/6daed429aa5449e2923488e535a6a243 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:31.669997 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cab931-a464-4533-b179-cabb1181ad43 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:31.716665 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6320c11-541e-4e81-9f40-a89f36be775e None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:31.762581 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e8d9a-93e6-48d5-921b-e2f74e8f7e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:31.765728 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e8d9a-93e6-48d5-921b-e2f74e8f7e98 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:31.767780 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e8d9a-93e6-48d5-921b-e2f74e8f7e98 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:31.769048 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e8d9a-93e6-48d5-921b-e2f74e8f7e98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:31.895925 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e8d9a-93e6-48d5-921b-e2f74e8f7e98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:31.897830 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e8d9a-93e6-48d5-921b-e2f74e8f7e98 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:31.916441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cab931-a464-4533-b179-cabb1181ad43 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:31.954617 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:31.961831 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849571f-247a-4d9d-ac34-772b7cc453af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:31.967902 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849571f-247a-4d9d-ac34-772b7cc453af None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:31.967902 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849571f-247a-4d9d-ac34-772b7cc453af None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:31.967902 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6849571f-247a-4d9d-ac34-772b7cc453af None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:31.967902 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849571f-247a-4d9d-ac34-772b7cc453af None admin] RBAC: Authorizing `identity:get_project(project_id=8c22dbab894644ce84024119b5b8a26c)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:31.970137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6849571f-247a-4d9d-ac34-772b7cc453af None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:31.974681 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 95/203] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:31 2022] GET /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c => generated 302 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:31.977597 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849571f-247a-4d9d-ac34-772b7cc453af None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:32.008672 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:32.037895 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 109/204] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:32.037895 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e8d9a-93e6-48d5-921b-e2f74e8f7e98 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:32.171672 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6849571f-247a-4d9d-ac34-772b7cc453af None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:32.201801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e8d9a-93e6-48d5-921b-e2f74e8f7e98 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:32.218558 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d6476-9871-4795-81f7-b15c2bde69f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:32.219454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d6476-9871-4795-81f7-b15c2bde69f4 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:32.219741 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d6476-9871-4795-81f7-b15c2bde69f4 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:32.220352 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89d6476-9871-4795-81f7-b15c2bde69f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:32.221237 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d6476-9871-4795-81f7-b15c2bde69f4 None admin] RBAC: Adding query filter params (role.id=29ddb77b56f449aa87fa909f2eebe434, scope.project.id=6daed429aa5449e2923488e535a6a243, user.id=bddc0a7e1d2d459ab04416e4c32f15a7) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:32.221559 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d6476-9871-4795-81f7-b15c2bde69f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:32.223563 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89d6476-9871-4795-81f7-b15c2bde69f4 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:32.232209 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 96/205] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:38:31 2022] GET /identity/v3/role_assignments?user.id=bddc0a7e1d2d459ab04416e4c32f15a7&scope.project.id=6daed429aa5449e2923488e535a6a243&role.id=29ddb77b56f449aa87fa909f2eebe434 => generated 608 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:32.233430 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d6476-9871-4795-81f7-b15c2bde69f4 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:32.238536 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707a3ba-c3ea-49dc-80f6-9ae4f6cfb9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:32.239220 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707a3ba-c3ea-49dc-80f6-9ae4f6cfb9e5 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:32.239506 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707a3ba-c3ea-49dc-80f6-9ae4f6cfb9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:32.239782 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8707a3ba-c3ea-49dc-80f6-9ae4f6cfb9e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:32.240685 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707a3ba-c3ea-49dc-80f6-9ae4f6cfb9e5 None admin] RBAC: Adding query filter params (role.id=ae72bfdddd1e4a94a21a0d53264ee157, scope.project.id=8c22dbab894644ce84024119b5b8a26c, user.id=f1c0ce5efc994a6885d6a36dce16cbdf) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:32.241001 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707a3ba-c3ea-49dc-80f6-9ae4f6cfb9e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:32.242505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8707a3ba-c3ea-49dc-80f6-9ae4f6cfb9e5 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:32.249130 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 110/206] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:38:32 2022] GET /identity/v3/role_assignments?user.id=f1c0ce5efc994a6885d6a36dce16cbdf&scope.project.id=8c22dbab894644ce84024119b5b8a26c&role.id=ae72bfdddd1e4a94a21a0d53264ee157 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:32.388511 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:32.418998 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89d6476-9871-4795-81f7-b15c2bde69f4 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:32.479347 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af5a22e-15cd-46ec-a5f0-baae9415cb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:32.480173 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5a22e-15cd-46ec-a5f0-baae9415cb92 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:32.480484 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5a22e-15cd-46ec-a5f0-baae9415cb92 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:32.480765 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af5a22e-15cd-46ec-a5f0-baae9415cb92 None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:32.485658 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5a22e-15cd-46ec-a5f0-baae9415cb92 None admin] RBAC: Authorizing `identity:get_project(project_id=8c22dbab894644ce84024119b5b8a26c)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:32.487202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af5a22e-15cd-46ec-a5f0-baae9415cb92 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:32.489551 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 97/207] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:32 2022] GET /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c => generated 302 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:32.495575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707a3ba-c3ea-49dc-80f6-9ae4f6cfb9e5 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:32.525798 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:32.629013 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8707a3ba-c3ea-49dc-80f6-9ae4f6cfb9e5 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:32.676761 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf90612a-7495-47e8-a7ab-91a2e33477dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:32.677813 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90612a-7495-47e8-a7ab-91a2e33477dc None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:32.678290 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90612a-7495-47e8-a7ab-91a2e33477dc None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:32.678785 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf90612a-7495-47e8-a7ab-91a2e33477dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:32.679835 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90612a-7495-47e8-a7ab-91a2e33477dc None admin] RBAC: Adding query filter params (role.id=abd8e1d1d7cd45cc93ed82f651c74d9b, scope.project.id=8c22dbab894644ce84024119b5b8a26c, user.id=f1c0ce5efc994a6885d6a36dce16cbdf) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:32.680338 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90612a-7495-47e8-a7ab-91a2e33477dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:32.682038 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf90612a-7495-47e8-a7ab-91a2e33477dc None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:32.689453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 111/208] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:38:32 2022] GET /identity/v3/role_assignments?user.id=f1c0ce5efc994a6885d6a36dce16cbdf&scope.project.id=8c22dbab894644ce84024119b5b8a26c&role.id=abd8e1d1d7cd45cc93ed82f651c74d9b => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:33.706758 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c3aaa-3a08-4e2f-8bc1-46ee5a3a51b4 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:33.707285 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c3aaa-3a08-4e2f-8bc1-46ee5a3a51b4 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:33.707285 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c3aaa-3a08-4e2f-8bc1-46ee5a3a51b4 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:33.709076 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 98/209] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:33.714670 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87edf1c-03b6-4bda-9bc1-e7b0309138d2 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:33.715168 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87edf1c-03b6-4bda-9bc1-e7b0309138d2 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:33.715244 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87edf1c-03b6-4bda-9bc1-e7b0309138d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:33.734623 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-d87edf1c-03b6-4bda-9bc1-e7b0309138d2 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:33.735908 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-d87edf1c-03b6-4bda-9bc1-e7b0309138d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:33.817250 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 112/210] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:33.843799 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c3aaa-3a08-4e2f-8bc1-46ee5a3a51b4 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:33.851174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa12979-2910-4e6c-9571-ac0be10fdc0e None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:33.851756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa12979-2910-4e6c-9571-ac0be10fdc0e None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:33.852225 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa12979-2910-4e6c-9571-ac0be10fdc0e None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:33.854089 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 113/211] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:33.860280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6e041-bdbe-4295-a92c-cae044dc4331 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:33.860902 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6e041-bdbe-4295-a92c-cae044dc4331 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:33.861473 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6e041-bdbe-4295-a92c-cae044dc4331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:33.879702 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-1fc6e041-bdbe-4295-a92c-cae044dc4331 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:33.881460 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-1fc6e041-bdbe-4295-a92c-cae044dc4331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:33.892808 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:33.961016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 114/212] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:38:33.970670 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c3aaa-3a08-4e2f-8bc1-46ee5a3a51b4 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:33.982760 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6e041-bdbe-4295-a92c-cae044dc4331 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:34.012126 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0c44c-b7eb-45da-b0ee-2b8f78dcbb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:34.013521 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0c44c-b7eb-45da-b0ee-2b8f78dcbb81 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:34.013823 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0c44c-b7eb-45da-b0ee-2b8f78dcbb81 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:34.014103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a0c44c-b7eb-45da-b0ee-2b8f78dcbb81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:34.031389 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a0c44c-b7eb-45da-b0ee-2b8f78dcbb81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:34.042390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-d6a0c44c-b7eb-45da-b0ee-2b8f78dcbb81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:34.042390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:34.042390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:34.042390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:34.042390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:34.042390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:34.042390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:34.042390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:34.042390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:34.042390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:34.042390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:34.042390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:34.042390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:34.042390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:34.042390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:34.042390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:34.043343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:34.043343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:34.043343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:34.043343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:34.043343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:34.043343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:34.043343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:34.043343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:34.043343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:34.043343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:34.043343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:34.043343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:38:34.043343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:34.043343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:34.043343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:34.043343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:34.044127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:34.044127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:34.044127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:34.044127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:34.044127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:34.044127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:34.044127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:34.044127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:34.044127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:34.044127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:34.044127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:34.044127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:38:34.044127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 99/213] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:34.052153 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0c44c-b7eb-45da-b0ee-2b8f78dcbb81 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:34.064649 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:34.120343 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6e041-bdbe-4295-a92c-cae044dc4331 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:34.173998 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f0695-573c-4e44-a3e1-04b3239bcff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:34.175345 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f0695-573c-4e44-a3e1-04b3239bcff6 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:34.175640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f0695-573c-4e44-a3e1-04b3239bcff6 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:34.175911 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76f0695-573c-4e44-a3e1-04b3239bcff6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:34.177654 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f0695-573c-4e44-a3e1-04b3239bcff6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:34.180042 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76f0695-573c-4e44-a3e1-04b3239bcff6 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:34.181900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 115/214] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:38:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:34.188590 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f0695-573c-4e44-a3e1-04b3239bcff6 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:34.201427 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:34.205582 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a0c44c-b7eb-45da-b0ee-2b8f78dcbb81 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:34.246571 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e65cf9-5315-4afc-8f98-c9f739dbb00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:34.247548 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e65cf9-5315-4afc-8f98-c9f739dbb00f None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:34.248003 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e65cf9-5315-4afc-8f98-c9f739dbb00f None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:34.248581 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e65cf9-5315-4afc-8f98-c9f739dbb00f None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:34.250147 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e65cf9-5315-4afc-8f98-c9f739dbb00f None admin] RBAC: Adding query filter params (name=member) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:34.250729 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e65cf9-5315-4afc-8f98-c9f739dbb00f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:34.252295 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e65cf9-5315-4afc-8f98-c9f739dbb00f None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:34.262436 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 100/215] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:34.268723 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e65cf9-5315-4afc-8f98-c9f739dbb00f None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:34.312739 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76f0695-573c-4e44-a3e1-04b3239bcff6 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:34.340320 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:34.352016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810f224-6597-4af4-8b25-28871adc8a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:34.352904 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810f224-6597-4af4-8b25-28871adc8a76 None admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:34.353204 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810f224-6597-4af4-8b25-28871adc8a76 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:34.353565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810f224-6597-4af4-8b25-28871adc8a76 None admin] PATH_INFO: `/v3/users` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:34.354353 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810f224-6597-4af4-8b25-28871adc8a76 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:34.355895 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810f224-6597-4af4-8b25-28871adc8a76 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:34.378539 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e65cf9-5315-4afc-8f98-c9f739dbb00f None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:34.417663 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba3f7c-edb1-4a04-b509-e55206a17381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:34.419022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba3f7c-edb1-4a04-b509-e55206a17381 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:34.419565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba3f7c-edb1-4a04-b509-e55206a17381 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:34.420011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ba3f7c-edb1-4a04-b509-e55206a17381 None admin] PATH_INFO: `/v3/users/7ab7857ccef34f8baf8d94c931f8f325` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:34.436264 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba3f7c-edb1-4a04-b509-e55206a17381 None admin] RBAC: Authorizing `identity:get_user(user_id=7ab7857ccef34f8baf8d94c931f8f325)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:34.438217 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ba3f7c-edb1-4a04-b509-e55206a17381 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:34.440408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 101/216] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:34 2022] GET /identity/v3/users/7ab7857ccef34f8baf8d94c931f8f325 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:34.445787 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba3f7c-edb1-4a04-b509-e55206a17381 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:34.485506 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 116/217] 10.222.0.62 () {60 vars in 1132 bytes} [Wed May 25 15:38:34 2022] POST /identity/v3/users => generated 297 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:38:34.587276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ba3f7c-edb1-4a04-b509-e55206a17381 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:34.622054 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:34.633442 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75217fca-612e-4f44-b79c-5e853a8b864e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:34.634122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75217fca-612e-4f44-b79c-5e853a8b864e None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:34.635531 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75217fca-612e-4f44-b79c-5e853a8b864e None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:34.635531 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75217fca-612e-4f44-b79c-5e853a8b864e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:34.716690 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75217fca-612e-4f44-b79c-5e853a8b864e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:34.718758 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75217fca-612e-4f44-b79c-5e853a8b864e None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:34.811667 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0e361-6707-46a0-9a65-a9be0a2d1a82 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:34.812294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0e361-6707-46a0-9a65-a9be0a2d1a82 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:34.812482 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe0e361-6707-46a0-9a65-a9be0a2d1a82 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:34.813964 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 117/218] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:34.820164 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130eee1-b1a7-427b-9226-d883d80717e8 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:34.820489 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130eee1-b1a7-427b-9226-d883d80717e8 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:34.820750 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f130eee1-b1a7-427b-9226-d883d80717e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:34.834603 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 102/219] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:34.840153 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75217fca-612e-4f44-b79c-5e853a8b864e None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:34.850683 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-f130eee1-b1a7-427b-9226-d883d80717e8 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:34.852294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-f130eee1-b1a7-427b-9226-d883d80717e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:34.873837 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:34.937260 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:34.953949 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 118/220] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:38:34.967728 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75217fca-612e-4f44-b79c-5e853a8b864e None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:34.980623 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130eee1-b1a7-427b-9226-d883d80717e8 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:35.021774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6baac8-b99d-453f-8304-9b7db7d6dd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:35.022919 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6baac8-b99d-453f-8304-9b7db7d6dd6d None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:35.023211 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6baac8-b99d-453f-8304-9b7db7d6dd6d None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:35.023492 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6baac8-b99d-453f-8304-9b7db7d6dd6d None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:35.024975 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6baac8-b99d-453f-8304-9b7db7d6dd6d None admin] RBAC: Authorizing `identity:get_project(project_id=8c22dbab894644ce84024119b5b8a26c)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:35.026444 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6baac8-b99d-453f-8304-9b7db7d6dd6d None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:35.029356 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 103/221] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:34 2022] GET /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:35.036397 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6baac8-b99d-453f-8304-9b7db7d6dd6d None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:35.138965 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f130eee1-b1a7-427b-9226-d883d80717e8 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:35.219972 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c510cb-f2aa-4f86-9a7f-54ffbbbc5b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:35.220809 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c510cb-f2aa-4f86-9a7f-54ffbbbc5b5b None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:35.221089 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c510cb-f2aa-4f86-9a7f-54ffbbbc5b5b None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:35.221358 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c510cb-f2aa-4f86-9a7f-54ffbbbc5b5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:35.225291 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:35.241263 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6baac8-b99d-453f-8304-9b7db7d6dd6d None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:35.244534 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c510cb-f2aa-4f86-9a7f-54ffbbbc5b5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:35.256245 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-e8c510cb-f2aa-4f86-9a7f-54ffbbbc5b5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:38:35.256245 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:35.256245 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:35.256245 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:35.256245 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:35.256245 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:35.256245 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:35.256245 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:35.256245 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:35.256245 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:35.256245 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:35.256245 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:35.256245 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:35.256245 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:35.256245 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:35.256245 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:35.257206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:35.257206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:35.257206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:35.257206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:35.257206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:35.257206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:35.257206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:35.257206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:35.257206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:35.257206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:35.257206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:35.257206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:35.257206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:35.257206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:35.257206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:35.257206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:35.258978 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:35.258978 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:35.258978 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:35.258978 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:35.258978 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:35.258978 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:35.258978 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:35.258978 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:35.258978 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:35.258978 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:35.258978 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:38:35.258978 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:35.258978 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 119/222] 10.222.0.62 () {56 vars in 1096 bytes} [Wed May 25 15:38:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:35.264609 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c510cb-f2aa-4f86-9a7f-54ffbbbc5b5b None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:35.326666 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:35.338062 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df11d09-421d-48a6-8790-c5cd1622e5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:35.343668 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df11d09-421d-48a6-8790-c5cd1622e5fa None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:35.343668 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df11d09-421d-48a6-8790-c5cd1622e5fa None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:35.343668 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df11d09-421d-48a6-8790-c5cd1622e5fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:35.343668 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df11d09-421d-48a6-8790-c5cd1622e5fa None admin] RBAC: Adding query filter params (role.id=5614294f6ab949a99424ee6e983b6430, scope.project.id=8c22dbab894644ce84024119b5b8a26c, user.id=7ab7857ccef34f8baf8d94c931f8f325) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:35.343668 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df11d09-421d-48a6-8790-c5cd1622e5fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:35.343668 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df11d09-421d-48a6-8790-c5cd1622e5fa None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:35.360016 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 104/223] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:38:35 2022] GET /identity/v3/role_assignments?user.id=7ab7857ccef34f8baf8d94c931f8f325&scope.project.id=8c22dbab894644ce84024119b5b8a26c&role.id=5614294f6ab949a99424ee6e983b6430 => generated 259 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:35.366278 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2869da-2902-4e25-b093-3e4c9cb628c5 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:35.366562 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2869da-2902-4e25-b093-3e4c9cb628c5 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:35.366841 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2869da-2902-4e25-b093-3e4c9cb628c5 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:35.368523 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 105/224] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:38:35.378161 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad56b01-5ac2-4d24-9f5c-ce80c191e6fb None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:35.378595 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad56b01-5ac2-4d24-9f5c-ce80c191e6fb None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:35.378881 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad56b01-5ac2-4d24-9f5c-ce80c191e6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:35.392990 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c510cb-f2aa-4f86-9a7f-54ffbbbc5b5b None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:35.425365 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-2ad56b01-5ac2-4d24-9f5c-ce80c191e6fb None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:35.426606 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-2ad56b01-5ac2-4d24-9f5c-ce80c191e6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:35.485459 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd398203-a0a5-4134-92f0-40ff94b9064b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:35.486547 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd398203-a0a5-4134-92f0-40ff94b9064b None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:35.487082 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd398203-a0a5-4134-92f0-40ff94b9064b None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:35.487582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd398203-a0a5-4134-92f0-40ff94b9064b None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:35.488632 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd398203-a0a5-4134-92f0-40ff94b9064b None admin] RBAC: Adding query filter params (name=admin) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:35.489163 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd398203-a0a5-4134-92f0-40ff94b9064b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:35.490825 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd398203-a0a5-4134-92f0-40ff94b9064b None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:35.508077 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 120/225] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:35.518438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd398203-a0a5-4134-92f0-40ff94b9064b None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:35.541012 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 106/226] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:35.567117 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad56b01-5ac2-4d24-9f5c-ce80c191e6fb None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:35.674960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd398203-a0a5-4134-92f0-40ff94b9064b None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:35.691459 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:35.715915 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecf839-5ea6-4222-8eee-332c8c2c8000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:35.716848 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecf839-5ea6-4222-8eee-332c8c2c8000 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:35.717135 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecf839-5ea6-4222-8eee-332c8c2c8000 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:35.717412 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecf839-5ea6-4222-8eee-332c8c2c8000 None admin] PATH_INFO: `/v3/users/f1c0ce5efc994a6885d6a36dce16cbdf` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:35.719021 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecf839-5ea6-4222-8eee-332c8c2c8000 None admin] RBAC: Authorizing `identity:get_user(user_id=f1c0ce5efc994a6885d6a36dce16cbdf)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:35.720993 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecf839-5ea6-4222-8eee-332c8c2c8000 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:35.722709 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 121/227] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:35 2022] GET /identity/v3/users/f1c0ce5efc994a6885d6a36dce16cbdf => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:35.728643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecf839-5ea6-4222-8eee-332c8c2c8000 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:35.731563 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:35.762600 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad56b01-5ac2-4d24-9f5c-ce80c191e6fb None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:35.804531 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c6c0a-faaf-4072-b77e-141d37945185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:35.805822 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c6c0a-faaf-4072-b77e-141d37945185 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:35.806307 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c6c0a-faaf-4072-b77e-141d37945185 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:35.806782 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24c6c0a-faaf-4072-b77e-141d37945185 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:35.819302 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24c6c0a-faaf-4072-b77e-141d37945185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:35.831925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-e24c6c0a-faaf-4072-b77e-141d37945185 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:38:35.831925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:35.831925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:35.831925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:35.831925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:35.831925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:35.831925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:35.831925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:35.831925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:35.831925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:35.831925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:35.831925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:35.831925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:35.831925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:35.831925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:35.831925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:35.833091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:35.833091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:35.833091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:35.833091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:35.833091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:35.833091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:35.833091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:35.833091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:35.833091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:35.833091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:35.833091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:35.833091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:38:35.833091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:35.833091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:35.833091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:35.833091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:35.833884 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:35.833884 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:35.833884 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:35.833884 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:35.833884 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:35.833884 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:35.833884 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:35.833884 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:35.833884 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:35.833884 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:35.833884 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:38:35.833884 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:38:35.836953 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 107/228] 10.222.0.62 () {56 vars in 1114 bytes} [Wed May 25 15:38:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:38:35.842454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c6c0a-faaf-4072-b77e-141d37945185 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:35.868860 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecf839-5ea6-4222-8eee-332c8c2c8000 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:35.935932 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27903c13-a3a4-4f5b-879d-ee0bd570517b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:35.936908 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27903c13-a3a4-4f5b-879d-ee0bd570517b None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:35.937189 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27903c13-a3a4-4f5b-879d-ee0bd570517b None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:35.937464 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27903c13-a3a4-4f5b-879d-ee0bd570517b None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:35.938686 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27903c13-a3a4-4f5b-879d-ee0bd570517b None admin] RBAC: Authorizing `identity:get_project(project_id=8c22dbab894644ce84024119b5b8a26c)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:35.940168 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27903c13-a3a4-4f5b-879d-ee0bd570517b None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:35.942240 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 122/229] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:35 2022] GET /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:35.949770 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27903c13-a3a4-4f5b-879d-ee0bd570517b None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:36.004586 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24c6c0a-faaf-4072-b77e-141d37945185 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:36.038523 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:36.054093 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fc062-24ab-48e9-994a-b26e4660163a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:36.055135 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fc062-24ab-48e9-994a-b26e4660163a None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:36.056608 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fc062-24ab-48e9-994a-b26e4660163a None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:36.057088 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233fc062-24ab-48e9-994a-b26e4660163a None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:36.058041 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fc062-24ab-48e9-994a-b26e4660163a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:36.059335 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fc062-24ab-48e9-994a-b26e4660163a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:36.061634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233fc062-24ab-48e9-994a-b26e4660163a None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:36.080811 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 108/230] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:38:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:36.088206 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fc062-24ab-48e9-994a-b26e4660163a None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:36.113378 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:36.178777 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27903c13-a3a4-4f5b-879d-ee0bd570517b None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:36.235309 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233fc062-24ab-48e9-994a-b26e4660163a None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:36.277986 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64710369-b2ee-4b72-bef5-c53a6a774560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:36.279090 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24980a-6a32-441e-84d3-a72e6d17f9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:36.279521 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64710369-b2ee-4b72-bef5-c53a6a774560 None admin] REQUEST_METHOD: `PUT` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:36.279979 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24980a-6a32-441e-84d3-a72e6d17f9ad None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:36.280186 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64710369-b2ee-4b72-bef5-c53a6a774560 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:36.280282 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24980a-6a32-441e-84d3-a72e6d17f9ad None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:36.281103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b24980a-6a32-441e-84d3-a72e6d17f9ad None admin] PATH_INFO: `/v3/users/f1c0ce5efc994a6885d6a36dce16cbdf` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:36.281608 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64710369-b2ee-4b72-bef5-c53a6a774560 None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c/users/f1c0ce5efc994a6885d6a36dce16cbdf/roles/ae72bfdddd1e4a94a21a0d53264ee157` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:36.282503 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24980a-6a32-441e-84d3-a72e6d17f9ad None admin] RBAC: Authorizing `identity:get_user(user_id=f1c0ce5efc994a6885d6a36dce16cbdf)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:36.284136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64710369-b2ee-4b72-bef5-c53a6a774560 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c22dbab894644ce84024119b5b8a26c, user_id=f1c0ce5efc994a6885d6a36dce16cbdf, role_id=ae72bfdddd1e4a94a21a0d53264ee157)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:36.284245 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b24980a-6a32-441e-84d3-a72e6d17f9ad None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:36.285949 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64710369-b2ee-4b72-bef5-c53a6a774560 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:36.286203 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 109/231] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:36 2022] GET /identity/v3/users/f1c0ce5efc994a6885d6a36dce16cbdf => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:36.297666 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24980a-6a32-441e-84d3-a72e6d17f9ad None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:36.386186 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:36.407977 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 123/232] 10.222.0.62 () {58 vars in 1439 bytes} [Wed May 25 15:38:35 2022] PUT /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c/users/f1c0ce5efc994a6885d6a36dce16cbdf/roles/ae72bfdddd1e4a94a21a0d53264ee157 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:38:36.411915 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b24980a-6a32-441e-84d3-a72e6d17f9ad None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:36.464162 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b390f97c-4ece-4fda-a7b8-a9b067be3d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:36.469858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390f97c-4ece-4fda-a7b8-a9b067be3d19 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:36.470165 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390f97c-4ece-4fda-a7b8-a9b067be3d19 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:36.470419 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b390f97c-4ece-4fda-a7b8-a9b067be3d19 None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:36.471841 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390f97c-4ece-4fda-a7b8-a9b067be3d19 None admin] RBAC: Authorizing `identity:get_project(project_id=8c22dbab894644ce84024119b5b8a26c)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:36.473351 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b390f97c-4ece-4fda-a7b8-a9b067be3d19 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:36.475479 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 110/233] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:36 2022] GET /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:36.481783 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64710369-b2ee-4b72-bef5-c53a6a774560 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:36.653484 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64710369-b2ee-4b72-bef5-c53a6a774560 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:36.674445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:36.710127 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03920905-5620-4b7e-97a3-4bc6803a2bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:36.711361 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03920905-5620-4b7e-97a3-4bc6803a2bdd None admin] REQUEST_METHOD: `PUT` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:36.711754 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03920905-5620-4b7e-97a3-4bc6803a2bdd None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:36.712214 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03920905-5620-4b7e-97a3-4bc6803a2bdd None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c/users/f1c0ce5efc994a6885d6a36dce16cbdf/roles/abd8e1d1d7cd45cc93ed82f651c74d9b` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:36.715071 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03920905-5620-4b7e-97a3-4bc6803a2bdd None admin] RBAC: Authorizing `identity:create_grant(project_id=8c22dbab894644ce84024119b5b8a26c, user_id=f1c0ce5efc994a6885d6a36dce16cbdf, role_id=abd8e1d1d7cd45cc93ed82f651c74d9b)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:36.716624 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03920905-5620-4b7e-97a3-4bc6803a2bdd None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:36.883285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 124/234] 10.222.0.62 () {58 vars in 1439 bytes} [Wed May 25 15:38:36 2022] PUT /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c/users/f1c0ce5efc994a6885d6a36dce16cbdf/roles/abd8e1d1d7cd45cc93ed82f651c74d9b => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:38:37.615537 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f33e3e-eef8-456a-abf6-2b25105d1bcd None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:37.616155 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f33e3e-eef8-456a-abf6-2b25105d1bcd None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:37.616281 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f33e3e-eef8-456a-abf6-2b25105d1bcd None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:37.618082 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 111/235] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:37.624117 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ab504-da12-401d-b0fd-4557e7800cb5 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:37.624493 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ab504-da12-401d-b0fd-4557e7800cb5 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:37.624818 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5ab504-da12-401d-b0fd-4557e7800cb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:37.647401 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-fe5ab504-da12-401d-b0fd-4557e7800cb5 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:37.649012 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-fe5ab504-da12-401d-b0fd-4557e7800cb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:37.726190 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 125/236] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:37.755726 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f33e3e-eef8-456a-abf6-2b25105d1bcd None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:37.867808 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f33e3e-eef8-456a-abf6-2b25105d1bcd None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:37.904976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce131dd5-9c02-4e17-b1de-1376b9b79760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:37.906484 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce131dd5-9c02-4e17-b1de-1376b9b79760 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:37.906771 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce131dd5-9c02-4e17-b1de-1376b9b79760 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:37.907112 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce131dd5-9c02-4e17-b1de-1376b9b79760 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:37.918640 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce131dd5-9c02-4e17-b1de-1376b9b79760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:37.927408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-ce131dd5-9c02-4e17-b1de-1376b9b79760 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:38:37.927408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:37.927408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:37.927408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:37.927408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:37.927408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:37.927408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:37.927408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:37.927408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:37.927408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:37.927408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:37.927408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:37.927408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:37.927408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:37.927408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:37.927408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:37.929038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:37.929038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:37.929038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:37.929038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:37.929038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:37.929038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:37.929038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:37.929038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:37.929038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:37.929038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:37.929038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:37.929038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:38:37.929038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:37.929038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:37.929038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:37.929038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:37.930600 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:37.930600 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:37.930600 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:37.930600 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:37.930600 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:37.930600 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:37.930600 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:37.930600 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:37.930600 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:37.930600 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:37.930600 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:38:37.930600 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:38:37.930600 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 112/237] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:37.936470 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac5ecc-797b-49da-af39-464034b23cbe None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:37.936470 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac5ecc-797b-49da-af39-464034b23cbe None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:37.936470 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac5ecc-797b-49da-af39-464034b23cbe None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:37.937770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce131dd5-9c02-4e17-b1de-1376b9b79760 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:37.938000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 126/238] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:37.942398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276dfa8-b83a-4221-91bd-d9a80a26fd46 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:37.942706 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276dfa8-b83a-4221-91bd-d9a80a26fd46 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:37.942938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276dfa8-b83a-4221-91bd-d9a80a26fd46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:37.944612 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:37.978776 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-7276dfa8-b83a-4221-91bd-d9a80a26fd46 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:37.980345 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-7276dfa8-b83a-4221-91bd-d9a80a26fd46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:38.105152 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 127/239] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:38.142351 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276dfa8-b83a-4221-91bd-d9a80a26fd46 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:38.180867 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:38.235046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce131dd5-9c02-4e17-b1de-1376b9b79760 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:38.256618 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276dfa8-b83a-4221-91bd-d9a80a26fd46 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:38.294903 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df6308-8e4c-421e-a2ae-340980b949f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:38.295833 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df6308-8e4c-421e-a2ae-340980b949f1 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:38.296751 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df6308-8e4c-421e-a2ae-340980b949f1 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:38.297112 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df6308-8e4c-421e-a2ae-340980b949f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:38.298418 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df6308-8e4c-421e-a2ae-340980b949f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:38.300178 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66df6308-8e4c-421e-a2ae-340980b949f1 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:38.302347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 128/240] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:38:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:38.310259 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df6308-8e4c-421e-a2ae-340980b949f1 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:38.329961 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4bbd6-7e20-4ca9-942f-ca2e0cfb6ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:38.330641 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4bbd6-7e20-4ca9-942f-ca2e0cfb6ec7 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:38.330926 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4bbd6-7e20-4ca9-942f-ca2e0cfb6ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:38.331207 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4bbd6-7e20-4ca9-942f-ca2e0cfb6ec7 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:38.331970 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4bbd6-7e20-4ca9-942f-ca2e0cfb6ec7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:38.332280 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4bbd6-7e20-4ca9-942f-ca2e0cfb6ec7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:38.333714 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4bbd6-7e20-4ca9-942f-ca2e0cfb6ec7 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:38.354892 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 113/241] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 421 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:38.372230 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4bbd6-7e20-4ca9-942f-ca2e0cfb6ec7 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:38.441430 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df6308-8e4c-421e-a2ae-340980b949f1 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:38.453392 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:38.479359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85fe00-595a-4454-8e69-44f85c8fdab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:38.480096 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85fe00-595a-4454-8e69-44f85c8fdab7 None admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:38.480470 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85fe00-595a-4454-8e69-44f85c8fdab7 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:38.480762 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85fe00-595a-4454-8e69-44f85c8fdab7 None admin] PATH_INFO: `/v3/users` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:38.481482 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85fe00-595a-4454-8e69-44f85c8fdab7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:38.482951 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a85fe00-595a-4454-8e69-44f85c8fdab7 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:38.485966 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:38.535149 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4bbd6-7e20-4ca9-942f-ca2e0cfb6ec7 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:38.578546 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da1a7a-e000-4ef1-a9d5-a8745542ad7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:38.578546 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da1a7a-e000-4ef1-a9d5-a8745542ad7a None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:38.578546 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da1a7a-e000-4ef1-a9d5-a8745542ad7a None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:38.578546 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63da1a7a-e000-4ef1-a9d5-a8745542ad7a None admin] PATH_INFO: `/v3/users/eae6079307bb43fa8fbcbbad5b839cfc` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:38.579512 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 129/242] 10.222.0.62 () {60 vars in 1132 bytes} [Wed May 25 15:38:38 2022] POST /identity/v3/users => generated 293 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:38:38.582541 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6784e-2141-4b02-90e1-b0563c0c2aa7 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:38.592613 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6784e-2141-4b02-90e1-b0563c0c2aa7 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:38.592613 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6784e-2141-4b02-90e1-b0563c0c2aa7 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:38.594353 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 130/243] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:38 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:38.600826 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7d2cc-818c-43c9-b5c3-da2be35258ff None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:38.601020 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7d2cc-818c-43c9-b5c3-da2be35258ff None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:38.601275 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c7d2cc-818c-43c9-b5c3-da2be35258ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:38.618842 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da1a7a-e000-4ef1-a9d5-a8745542ad7a None admin] RBAC: Authorizing `identity:get_user(user_id=eae6079307bb43fa8fbcbbad5b839cfc)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:38.621364 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63da1a7a-e000-4ef1-a9d5-a8745542ad7a None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:38.624884 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-12c7d2cc-818c-43c9-b5c3-da2be35258ff None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:38.625235 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 114/244] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:38 2022] GET /identity/v3/users/eae6079307bb43fa8fbcbbad5b839cfc => generated 297 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:38.627793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-12c7d2cc-818c-43c9-b5c3-da2be35258ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:38.632450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da1a7a-e000-4ef1-a9d5-a8745542ad7a None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:38.774181 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 131/245] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:38.824335 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63da1a7a-e000-4ef1-a9d5-a8745542ad7a None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:38.840936 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7d2cc-818c-43c9-b5c3-da2be35258ff None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:38.903489 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:38.912890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f44f0-ca90-44ce-bd5d-2f1fbca34522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:38.913565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f44f0-ca90-44ce-bd5d-2f1fbca34522 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:38.913852 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f44f0-ca90-44ce-bd5d-2f1fbca34522 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:38.914132 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204f44f0-ca90-44ce-bd5d-2f1fbca34522 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:38.952931 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:38.973875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c7d2cc-818c-43c9-b5c3-da2be35258ff None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:39.010153 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f44f0-ca90-44ce-bd5d-2f1fbca34522 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:39.011938 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204f44f0-ca90-44ce-bd5d-2f1fbca34522 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:39.019027 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3c92d-569a-479a-b73c-7cfb28c000b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:39.020611 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3c92d-569a-479a-b73c-7cfb28c000b8 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:39.021281 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3c92d-569a-479a-b73c-7cfb28c000b8 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:39.021729 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b3c92d-569a-479a-b73c-7cfb28c000b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:39.043730 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b3c92d-569a-479a-b73c-7cfb28c000b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:39.054139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-93b3c92d-569a-479a-b73c-7cfb28c000b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:39.054139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:39.054139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:39.054139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:39.054139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:39.054139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:39.054139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:39.054139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:39.054139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:39.054139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:39.054139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:39.054139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:39.054139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:39.054139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:39.054139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:39.054139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:39.062016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:39.062016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:39.062016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:39.062016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:39.062016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:39.062016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:39.062016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:39.062016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:39.062016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:39.062016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:39.062016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:39.062016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:39.062016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:39.062016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:39.062016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:39.062016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:39.063041 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:39.063041 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:39.063041 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:39.063041 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:39.063041 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:39.063041 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:39.063041 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:39.063041 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:39.063041 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:39.063041 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:39.063041 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:39.063041 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:39.063041 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 132/246] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:38:39.064813 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3c92d-569a-479a-b73c-7cfb28c000b8 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:39.152248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 115/247] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 15:38:39.157956 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f44f0-ca90-44ce-bd5d-2f1fbca34522 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:39.187585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b3c92d-569a-479a-b73c-7cfb28c000b8 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:39.191133 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:39.229133 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecc859-4600-41ec-8aab-59d0b3ac0d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:39.230118 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecc859-4600-41ec-8aab-59d0b3ac0d13 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:39.230549 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecc859-4600-41ec-8aab-59d0b3ac0d13 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:39.230970 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecc859-4600-41ec-8aab-59d0b3ac0d13 None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:39.232013 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecc859-4600-41ec-8aab-59d0b3ac0d13 None admin] RBAC: Adding query filter params (name=member) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:39.232578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecc859-4600-41ec-8aab-59d0b3ac0d13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:39.234324 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecc859-4600-41ec-8aab-59d0b3ac0d13 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:39.245741 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 133/248] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:39.253651 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecc859-4600-41ec-8aab-59d0b3ac0d13 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:39.264651 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:39.294294 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204f44f0-ca90-44ce-bd5d-2f1fbca34522 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:39.337730 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afd7f6-a7f9-43e6-ab9e-362ab7dfabc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:39.339292 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afd7f6-a7f9-43e6-ab9e-362ab7dfabc4 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:39.339779 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afd7f6-a7f9-43e6-ab9e-362ab7dfabc4 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:39.340067 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2afd7f6-a7f9-43e6-ab9e-362ab7dfabc4 None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:39.342340 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afd7f6-a7f9-43e6-ab9e-362ab7dfabc4 None admin] RBAC: Authorizing `identity:get_project(project_id=8c22dbab894644ce84024119b5b8a26c)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:39.345043 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2afd7f6-a7f9-43e6-ab9e-362ab7dfabc4 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:39.347584 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 116/249] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:39 2022] GET /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:39.353995 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afd7f6-a7f9-43e6-ab9e-362ab7dfabc4 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:39.395713 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecc859-4600-41ec-8aab-59d0b3ac0d13 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:39.450176 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00344c6-eadc-4083-b3a0-4a8244d1b539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:39.452169 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00344c6-eadc-4083-b3a0-4a8244d1b539 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:39.453073 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00344c6-eadc-4083-b3a0-4a8244d1b539 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:39.453575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00344c6-eadc-4083-b3a0-4a8244d1b539 None admin] PATH_INFO: `/v3/users/7ab7857ccef34f8baf8d94c931f8f325` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:39.455324 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00344c6-eadc-4083-b3a0-4a8244d1b539 None admin] RBAC: Authorizing `identity:get_user(user_id=7ab7857ccef34f8baf8d94c931f8f325)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:39.456966 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00344c6-eadc-4083-b3a0-4a8244d1b539 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:39.459941 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 134/250] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:39 2022] GET /identity/v3/users/7ab7857ccef34f8baf8d94c931f8f325 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:39.466292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00344c6-eadc-4083-b3a0-4a8244d1b539 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:39.505121 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:39.515772 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2afd7f6-a7f9-43e6-ab9e-362ab7dfabc4 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:39.567827 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:39.595611 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00344c6-eadc-4083-b3a0-4a8244d1b539 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:39.636436 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3040594-e4e8-4a52-8f73-8d14c16088ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:39.637111 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3040594-e4e8-4a52-8f73-8d14c16088ee None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:39.637408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3040594-e4e8-4a52-8f73-8d14c16088ee None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:39.637692 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3040594-e4e8-4a52-8f73-8d14c16088ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:39.638548 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3040594-e4e8-4a52-8f73-8d14c16088ee None admin] RBAC: Adding query filter params (role.id=29ddb77b56f449aa87fa909f2eebe434, scope.project.id=8c22dbab894644ce84024119b5b8a26c, user.id=eae6079307bb43fa8fbcbbad5b839cfc) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:39.638866 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3040594-e4e8-4a52-8f73-8d14c16088ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:39.641578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6430fd5-1af1-4a2b-935f-559a51dc3c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:39.642460 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6430fd5-1af1-4a2b-935f-559a51dc3c09 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:39.645479 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6430fd5-1af1-4a2b-935f-559a51dc3c09 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:39.645479 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6430fd5-1af1-4a2b-935f-559a51dc3c09 None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:39.645630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3040594-e4e8-4a52-8f73-8d14c16088ee None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:39.646084 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6430fd5-1af1-4a2b-935f-559a51dc3c09 None admin] RBAC: Authorizing `identity:get_project(project_id=8c22dbab894644ce84024119b5b8a26c)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:39.647550 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6430fd5-1af1-4a2b-935f-559a51dc3c09 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:39.649322 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 135/251] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:39 2022] GET /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:39.650547 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04f4f6-d204-4e71-bec7-121c759b2f13 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:39.650836 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04f4f6-d204-4e71-bec7-121c759b2f13 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:39.651113 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a04f4f6-d204-4e71-bec7-121c759b2f13 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:39.652362 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 136/252] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:39.657569 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04f4f6-d204-4e71-bec7-121c759b2f13 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:39.667662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 117/253] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:38:39 2022] GET /identity/v3/role_assignments?user.id=eae6079307bb43fa8fbcbbad5b839cfc&scope.project.id=8c22dbab894644ce84024119b5b8a26c&role.id=29ddb77b56f449aa87fa909f2eebe434 => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:39.669090 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa4435-a680-4dbc-95b5-794b52ffc62c None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:39.669382 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa4435-a680-4dbc-95b5-794b52ffc62c None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:39.669663 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aa4435-a680-4dbc-95b5-794b52ffc62c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:39.702174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-89aa4435-a680-4dbc-95b5-794b52ffc62c None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:39.704083 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-89aa4435-a680-4dbc-95b5-794b52ffc62c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:39.855313 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 118/254] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:39.891198 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a04f4f6-d204-4e71-bec7-121c759b2f13 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:39.904920 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa4435-a680-4dbc-95b5-794b52ffc62c None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:39.948591 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4357f4d-93fc-404f-9a0f-f67847d6be38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:39.949883 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4357f4d-93fc-404f-9a0f-f67847d6be38 None admin] REQUEST_METHOD: `PUT` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:39.950359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4357f4d-93fc-404f-9a0f-f67847d6be38 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:39.950828 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4357f4d-93fc-404f-9a0f-f67847d6be38 None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c/users/7ab7857ccef34f8baf8d94c931f8f325/roles/5614294f6ab949a99424ee6e983b6430` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:39.956288 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4357f4d-93fc-404f-9a0f-f67847d6be38 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c22dbab894644ce84024119b5b8a26c, user_id=7ab7857ccef34f8baf8d94c931f8f325, role_id=5614294f6ab949a99424ee6e983b6430)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:39.959346 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4357f4d-93fc-404f-9a0f-f67847d6be38 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:40.038395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 137/255] 10.222.0.62 () {58 vars in 1439 bytes} [Wed May 25 15:38:39 2022] PUT /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c/users/7ab7857ccef34f8baf8d94c931f8f325/roles/5614294f6ab949a99424ee6e983b6430 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:38:40.069650 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:40.086208 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aa4435-a680-4dbc-95b5-794b52ffc62c None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:40.086403 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f036577-5364-493d-9581-244c4d12369e None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:40.086640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f036577-5364-493d-9581-244c4d12369e None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:40.086930 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f036577-5364-493d-9581-244c4d12369e None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:40.088393 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 138/256] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:38:40.105446 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc06ce5-6f82-4609-a36f-f6686776162d None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:40.105721 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc06ce5-6f82-4609-a36f-f6686776162d None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:40.105931 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc06ce5-6f82-4609-a36f-f6686776162d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:40.127966 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:40.130805 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c8a69-1162-4ea6-9080-2c4ecd99b1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:40.131691 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c8a69-1162-4ea6-9080-2c4ecd99b1e4 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:40.131995 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c8a69-1162-4ea6-9080-2c4ecd99b1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:40.132266 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3c8a69-1162-4ea6-9080-2c4ecd99b1e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:40.149574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3c8a69-1162-4ea6-9080-2c4ecd99b1e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:40.162416 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-eb3c8a69-1162-4ea6-9080-2c4ecd99b1e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:38:40.162416 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:40.162416 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:40.162416 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:40.162416 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:40.162416 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:40.162416 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:40.162416 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:40.162416 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:40.162416 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:40.162416 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:40.162416 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:40.162416 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:40.162416 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:40.162416 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:40.162416 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:40.163361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:40.163361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:40.163361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:40.163361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:40.163361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:40.163361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:40.163361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:40.163361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:40.163361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:40.163361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:40.163361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:40.163361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:38:40.163361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:40.163361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:40.163361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:40.163361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:40.164143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:40.164143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:40.164143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:40.164143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:40.164143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:40.164143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:40.164143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:40.164143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:40.164143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:40.164143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:40.164143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:38:40.164143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:38:40.164143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 119/257] 10.222.0.62 () {56 vars in 1096 bytes} [Wed May 25 15:38:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:38:40.168531 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-7dc06ce5-6f82-4609-a36f-f6686776162d None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:40.170165 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c8a69-1162-4ea6-9080-2c4ecd99b1e4 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:40.171372 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-7dc06ce5-6f82-4609-a36f-f6686776162d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:40.392608 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3c8a69-1162-4ea6-9080-2c4ecd99b1e4 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:40.453417 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857a676-410a-4764-94c9-3e11fe93158c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:40.454667 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857a676-410a-4764-94c9-3e11fe93158c None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:40.454667 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857a676-410a-4764-94c9-3e11fe93158c None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:40.454846 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a857a676-410a-4764-94c9-3e11fe93158c None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:40.455557 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857a676-410a-4764-94c9-3e11fe93158c None admin] RBAC: Adding query filter params (name=admin) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:40.455875 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857a676-410a-4764-94c9-3e11fe93158c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:40.457113 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 139/258] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:38:40.457325 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a857a676-410a-4764-94c9-3e11fe93158c None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:40.477025 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 120/259] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:40.482828 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc06ce5-6f82-4609-a36f-f6686776162d None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:40.495953 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857a676-410a-4764-94c9-3e11fe93158c None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:40.520647 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:40.677910 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc06ce5-6f82-4609-a36f-f6686776162d None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:40.690146 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a857a676-410a-4764-94c9-3e11fe93158c None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:40.740865 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:40.747741 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b9a69-60b2-4f92-aa13-7ce45f4a9573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:40.748746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b9a69-60b2-4f92-aa13-7ce45f4a9573 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:40.760771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b9a69-60b2-4f92-aa13-7ce45f4a9573 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:40.760771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5b9a69-60b2-4f92-aa13-7ce45f4a9573 None admin] PATH_INFO: `/v3/users/f1c0ce5efc994a6885d6a36dce16cbdf` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:40.760771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b9a69-60b2-4f92-aa13-7ce45f4a9573 None admin] RBAC: Authorizing `identity:get_user(user_id=f1c0ce5efc994a6885d6a36dce16cbdf)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:40.760771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5b9a69-60b2-4f92-aa13-7ce45f4a9573 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:40.761069 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b94e28-394a-448d-9785-b7eae1771148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:40.761456 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b94e28-394a-448d-9785-b7eae1771148 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:40.761748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b94e28-394a-448d-9785-b7eae1771148 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:40.762029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b94e28-394a-448d-9785-b7eae1771148 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:40.762577 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 140/260] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:40 2022] GET /identity/v3/users/f1c0ce5efc994a6885d6a36dce16cbdf => generated 283 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:40.767196 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b9a69-60b2-4f92-aa13-7ce45f4a9573 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:40.786841 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b94e28-394a-448d-9785-b7eae1771148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:40.796369 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-72b94e28-394a-448d-9785-b7eae1771148 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:38:40.796369 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:40.796369 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:40.796369 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:40.796369 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:40.796369 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:40.796369 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:40.796369 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:40.796369 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:40.796369 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:40.796369 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:40.796369 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:40.796369 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:40.796369 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:40.796369 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:40.796369 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:40.797662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:40.797662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:40.797662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:40.797662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:40.797662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:40.797662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:40.797662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:40.797662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:40.797662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:40.797662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:40.797662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:40.797662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:38:40.797662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:40.797662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:40.797662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:40.797662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:40.798481 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:40.798481 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:40.798481 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:40.798481 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:40.798481 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:40.798481 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:40.798481 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:40.798481 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:40.798481 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:40.798481 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:40.798481 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:38:40.798481 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:38:40.798481 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 121/261] 10.222.0.62 () {56 vars in 1114 bytes} [Wed May 25 15:38:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:38:40.806325 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b94e28-394a-448d-9785-b7eae1771148 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:40.959188 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:40.978577 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5b9a69-60b2-4f92-aa13-7ce45f4a9573 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:41.003639 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b94e28-394a-448d-9785-b7eae1771148 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:41.042589 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b9f73-f642-4acb-8da7-f6372c7e7425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:41.043708 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b9f73-f642-4acb-8da7-f6372c7e7425 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:41.044002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b9f73-f642-4acb-8da7-f6372c7e7425 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:41.044286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b9f73-f642-4acb-8da7-f6372c7e7425 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:41.045224 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b9f73-f642-4acb-8da7-f6372c7e7425 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:41.045554 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b9f73-f642-4acb-8da7-f6372c7e7425 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:41.047956 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b9f73-f642-4acb-8da7-f6372c7e7425 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:41.055721 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06618588-9ce4-4111-bb52-af2bfde02397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:41.056681 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06618588-9ce4-4111-bb52-af2bfde02397 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:41.057122 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06618588-9ce4-4111-bb52-af2bfde02397 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:41.058048 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 122/262] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:38:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:41.058144 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06618588-9ce4-4111-bb52-af2bfde02397 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:41.065493 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b9f73-f642-4acb-8da7-f6372c7e7425 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:41.245409 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b9f73-f642-4acb-8da7-f6372c7e7425 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:41.250988 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:41.254578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06618588-9ce4-4111-bb52-af2bfde02397 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:41.256079 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06618588-9ce4-4111-bb52-af2bfde02397 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:41.282351 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a4f16-de15-47fc-b0ef-efb8d1396c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:41.283248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a4f16-de15-47fc-b0ef-efb8d1396c3e None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:41.283539 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a4f16-de15-47fc-b0ef-efb8d1396c3e None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:41.283822 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a4f16-de15-47fc-b0ef-efb8d1396c3e None admin] PATH_INFO: `/v3/users/f1c0ce5efc994a6885d6a36dce16cbdf` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:41.285089 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a4f16-de15-47fc-b0ef-efb8d1396c3e None admin] RBAC: Authorizing `identity:get_user(user_id=f1c0ce5efc994a6885d6a36dce16cbdf)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:41.286567 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a4f16-de15-47fc-b0ef-efb8d1396c3e None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:41.288296 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 123/263] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:41 2022] GET /identity/v3/users/f1c0ce5efc994a6885d6a36dce16cbdf => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:41.288858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:41.293951 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a4f16-de15-47fc-b0ef-efb8d1396c3e None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:41.421864 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 141/264] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 655 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:41.429442 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06618588-9ce4-4111-bb52-af2bfde02397 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:41.434635 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a4f16-de15-47fc-b0ef-efb8d1396c3e None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:41.521407 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda32cc9-39bf-4d0e-aef0-da72dbda0365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:41.522014 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda32cc9-39bf-4d0e-aef0-da72dbda0365 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:41.522310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda32cc9-39bf-4d0e-aef0-da72dbda0365 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:41.522581 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda32cc9-39bf-4d0e-aef0-da72dbda0365 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:41.623576 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:41.629376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06618588-9ce4-4111-bb52-af2bfde02397 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:41.695359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647d080-12db-4f7a-a6b0-e68d4add9108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:41.696703 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647d080-12db-4f7a-a6b0-e68d4add9108 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:41.697335 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647d080-12db-4f7a-a6b0-e68d4add9108 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:41.697827 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9647d080-12db-4f7a-a6b0-e68d4add9108 None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:41.699290 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647d080-12db-4f7a-a6b0-e68d4add9108 None admin] RBAC: Authorizing `identity:get_project(project_id=8c22dbab894644ce84024119b5b8a26c)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:41.701159 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9647d080-12db-4f7a-a6b0-e68d4add9108 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:41.703837 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 142/265] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:41 2022] GET /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:41.710398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647d080-12db-4f7a-a6b0-e68d4add9108 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:41.725897 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:41.734353 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda32cc9-39bf-4d0e-aef0-da72dbda0365 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:41.736026 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda32cc9-39bf-4d0e-aef0-da72dbda0365 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:41.924861 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 124/266] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:41.930706 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda32cc9-39bf-4d0e-aef0-da72dbda0365 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:41.962582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9647d080-12db-4f7a-a6b0-e68d4add9108 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:42.052292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18934a68-f6b1-40f5-9e8f-7c3b03a3db2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:42.053893 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18934a68-f6b1-40f5-9e8f-7c3b03a3db2a None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:42.054383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18934a68-f6b1-40f5-9e8f-7c3b03a3db2a None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:42.054883 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18934a68-f6b1-40f5-9e8f-7c3b03a3db2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:42.056171 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18934a68-f6b1-40f5-9e8f-7c3b03a3db2a None admin] RBAC: Adding query filter params (role.id=ae72bfdddd1e4a94a21a0d53264ee157, scope.project.id=8c22dbab894644ce84024119b5b8a26c, user.id=f1c0ce5efc994a6885d6a36dce16cbdf) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:42.056727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18934a68-f6b1-40f5-9e8f-7c3b03a3db2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:42.058363 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18934a68-f6b1-40f5-9e8f-7c3b03a3db2a None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:42.070097 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 143/267] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:38:41 2022] GET /identity/v3/role_assignments?user.id=f1c0ce5efc994a6885d6a36dce16cbdf&scope.project.id=8c22dbab894644ce84024119b5b8a26c&role.id=ae72bfdddd1e4a94a21a0d53264ee157 => generated 608 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:42.169462 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:42.177237 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda32cc9-39bf-4d0e-aef0-da72dbda0365 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:42.244254 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e04f7e-f944-46e9-a12c-08943df8ee88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:42.245179 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e04f7e-f944-46e9-a12c-08943df8ee88 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:42.245472 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e04f7e-f944-46e9-a12c-08943df8ee88 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:42.245750 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e04f7e-f944-46e9-a12c-08943df8ee88 None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:42.247031 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e04f7e-f944-46e9-a12c-08943df8ee88 None admin] RBAC: Authorizing `identity:get_project(project_id=8c22dbab894644ce84024119b5b8a26c)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:42.248692 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e04f7e-f944-46e9-a12c-08943df8ee88 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:42.252064 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 125/268] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:41 2022] GET /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c => generated 302 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:42.257489 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18934a68-f6b1-40f5-9e8f-7c3b03a3db2a None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:42.313998 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:42.414275 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18934a68-f6b1-40f5-9e8f-7c3b03a3db2a None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:42.455317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9587c-e34a-4e3b-9e54-d9aef233a895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:42.455923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9587c-e34a-4e3b-9e54-d9aef233a895 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:42.456205 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9587c-e34a-4e3b-9e54-d9aef233a895 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:42.456509 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9587c-e34a-4e3b-9e54-d9aef233a895 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:42.457399 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9587c-e34a-4e3b-9e54-d9aef233a895 None admin] RBAC: Adding query filter params (role.id=abd8e1d1d7cd45cc93ed82f651c74d9b, scope.project.id=8c22dbab894644ce84024119b5b8a26c, user.id=f1c0ce5efc994a6885d6a36dce16cbdf) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:42.457708 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9587c-e34a-4e3b-9e54-d9aef233a895 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:42.459301 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9587c-e34a-4e3b-9e54-d9aef233a895 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:42.466852 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 144/269] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:38:42 2022] GET /identity/v3/role_assignments?user.id=f1c0ce5efc994a6885d6a36dce16cbdf&scope.project.id=8c22dbab894644ce84024119b5b8a26c&role.id=abd8e1d1d7cd45cc93ed82f651c74d9b => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:42.679118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca411d-5a1e-48e1-be13-dcdcc7ee920c None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:42.679586 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca411d-5a1e-48e1-be13-dcdcc7ee920c None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:42.679792 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ca411d-5a1e-48e1-be13-dcdcc7ee920c None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:42.681219 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 126/270] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:42.687665 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2c35e-3a3b-4d64-8342-bdc34de768a3 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:42.688325 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2c35e-3a3b-4d64-8342-bdc34de768a3 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:42.688857 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b2c35e-3a3b-4d64-8342-bdc34de768a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:42.708298 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-30b2c35e-3a3b-4d64-8342-bdc34de768a3 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:42.710034 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-30b2c35e-3a3b-4d64-8342-bdc34de768a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:42.792555 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 145/271] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:42.821370 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99736a-b0d7-4def-86cc-394777839dd9 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:42.821936 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2c35e-3a3b-4d64-8342-bdc34de768a3 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:42.822490 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99736a-b0d7-4def-86cc-394777839dd9 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:42.822990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce99736a-b0d7-4def-86cc-394777839dd9 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:42.826035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 127/272] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:42.836469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c166faf-ac79-486b-a6fa-6f5a844c6ce8 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:42.837398 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c166faf-ac79-486b-a6fa-6f5a844c6ce8 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:42.838405 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c166faf-ac79-486b-a6fa-6f5a844c6ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:42.867046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:42.878348 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-7c166faf-ac79-486b-a6fa-6f5a844c6ce8 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:42.883722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-7c166faf-ac79-486b-a6fa-6f5a844c6ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:42.995022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 128/273] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:43.011153 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b2c35e-3a3b-4d64-8342-bdc34de768a3 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:43.054111 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c166faf-ac79-486b-a6fa-6f5a844c6ce8 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:43.072512 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db161788-9223-407e-a120-4323a4e62dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:43.073346 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db161788-9223-407e-a120-4323a4e62dd8 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:43.073630 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db161788-9223-407e-a120-4323a4e62dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:43.073930 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db161788-9223-407e-a120-4323a4e62dd8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:43.093324 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db161788-9223-407e-a120-4323a4e62dd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:43.101468 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-db161788-9223-407e-a120-4323a4e62dd8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:43.101468 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:43.101468 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:43.101468 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:43.101468 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:43.101468 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:43.101468 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:43.101468 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:43.101468 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:43.101468 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:43.101468 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:43.101468 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:43.101468 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:43.101468 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:43.101468 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:43.101468 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:43.102418 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:43.102418 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:43.102418 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:43.102418 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:43.102418 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:43.102418 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:43.102418 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:43.102418 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:43.102418 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:43.102418 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:43.102418 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:43.102418 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:43.102418 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:43.102418 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:43.102418 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:43.102418 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:43.103194 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:43.103194 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:43.103194 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:43.103194 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:43.103194 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:43.103194 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:43.103194 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:43.103194 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:43.103194 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:43.103194 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:43.103194 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:43.103194 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:43.103194 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 146/274] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:43.104398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56641c-b791-4a87-9b68-80bba4891cb1 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:43.104850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56641c-b791-4a87-9b68-80bba4891cb1 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:43.105277 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56641c-b791-4a87-9b68-80bba4891cb1 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:43.106752 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 147/275] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:43.114445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56641c-b791-4a87-9b68-80bba4891cb1 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:43.196712 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:43.201535 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c166faf-ac79-486b-a6fa-6f5a844c6ce8 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:43.237187 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:43.245649 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e09fc-76bc-4845-93f0-d3a9fba65169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:43.246565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e09fc-76bc-4845-93f0-d3a9fba65169 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:43.246754 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e09fc-76bc-4845-93f0-d3a9fba65169 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:43.247013 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e09fc-76bc-4845-93f0-d3a9fba65169 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:43.248209 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e09fc-76bc-4845-93f0-d3a9fba65169 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:43.250415 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e09fc-76bc-4845-93f0-d3a9fba65169 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:43.253166 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 129/276] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:38:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:43.253982 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb51ef-01f6-4078-be4f-f7f80614b610 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:43.254276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb51ef-01f6-4078-be4f-f7f80614b610 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:43.254553 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6eb51ef-01f6-4078-be4f-f7f80614b610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:43.261281 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56641c-b791-4a87-9b68-80bba4891cb1 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:43.276903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-e6eb51ef-01f6-4078-be4f-f7f80614b610 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:43.278502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-e6eb51ef-01f6-4078-be4f-f7f80614b610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:43.302514 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7d0a3-7b6b-40a7-9add-2c7e82919545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:43.303190 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7d0a3-7b6b-40a7-9add-2c7e82919545 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:43.303470 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7d0a3-7b6b-40a7-9add-2c7e82919545 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:43.303742 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef7d0a3-7b6b-40a7-9add-2c7e82919545 None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:43.304546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7d0a3-7b6b-40a7-9add-2c7e82919545 None admin] RBAC: Adding query filter params (name=member) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:43.304849 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7d0a3-7b6b-40a7-9add-2c7e82919545 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:43.306323 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef7d0a3-7b6b-40a7-9add-2c7e82919545 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:43.316161 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 148/277] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:43.321678 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7d0a3-7b6b-40a7-9add-2c7e82919545 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:43.360644 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 130/278] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:43.361915 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb51ef-01f6-4078-be4f-f7f80614b610 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:43.474264 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef7d0a3-7b6b-40a7-9add-2c7e82919545 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:43.486771 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:43.494158 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6eb51ef-01f6-4078-be4f-f7f80614b610 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:43.515584 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5050a55-b218-4259-839c-b9e1897fdf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:43.516224 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5050a55-b218-4259-839c-b9e1897fdf6e None admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:43.516543 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5050a55-b218-4259-839c-b9e1897fdf6e None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:43.516825 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5050a55-b218-4259-839c-b9e1897fdf6e None admin] PATH_INFO: `/v3/users` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:43.517973 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5050a55-b218-4259-839c-b9e1897fdf6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:43.519708 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5050a55-b218-4259-839c-b9e1897fdf6e None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:43.535413 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef93b06-65a6-4db5-9ace-b0142df88dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:43.536301 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef93b06-65a6-4db5-9ace-b0142df88dfb None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:43.536620 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef93b06-65a6-4db5-9ace-b0142df88dfb None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:43.536896 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef93b06-65a6-4db5-9ace-b0142df88dfb None admin] PATH_INFO: `/v3/users/572b6b6b9aaf446693b9e7ae0691539a` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:43.554668 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef93b06-65a6-4db5-9ace-b0142df88dfb None admin] RBAC: Authorizing `identity:get_user(user_id=572b6b6b9aaf446693b9e7ae0691539a)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:43.556175 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef93b06-65a6-4db5-9ace-b0142df88dfb None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:43.557991 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 131/279] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:43 2022] GET /identity/v3/users/572b6b6b9aaf446693b9e7ae0691539a => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:43.558766 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef93b06-65a6-4db5-9ace-b0142df88dfb None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:43.665008 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef93b06-65a6-4db5-9ace-b0142df88dfb None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:43.672762 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 149/280] 10.222.0.62 () {60 vars in 1132 bytes} [Wed May 25 15:38:43 2022] POST /identity/v3/users => generated 293 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:38:43.673627 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5050a55-b218-4259-839c-b9e1897fdf6e None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:43.677490 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:43.716392 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e9acb-a37f-4686-bc31-161b6e8c4245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:43.722903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e9acb-a37f-4686-bc31-161b6e8c4245 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:43.722903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e9acb-a37f-4686-bc31-161b6e8c4245 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:43.722903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e9acb-a37f-4686-bc31-161b6e8c4245 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:43.740126 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e9acb-a37f-4686-bc31-161b6e8c4245 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:43.750287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-de3e9acb-a37f-4686-bc31-161b6e8c4245 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:38:43.750287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:43.750287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:43.750287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:43.750287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:43.750287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:43.750287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:43.750287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:43.750287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:43.750287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:43.750287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:43.750287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:43.750287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:43.750287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:43.750287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:43.750287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:43.751506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:43.751506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:43.751506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:43.751506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:43.751506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:43.751506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:43.751506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:43.751506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:43.751506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:43.751506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:43.751506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:43.751506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:38:43.751506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:43.751506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:43.751506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:43.751506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:43.752290 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:43.752290 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:43.752290 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:43.752290 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:43.752290 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:43.752290 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:43.752290 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:43.752290 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:43.752290 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:43.752290 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:43.752290 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:38:43.752290 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:38:43.753551 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 132/281] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:43.755367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d25b1-da49-4206-91d5-97248bdc4bcc None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:43.755914 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d25b1-da49-4206-91d5-97248bdc4bcc None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:43.756177 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d25b1-da49-4206-91d5-97248bdc4bcc None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:43.757901 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 133/282] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:43.758714 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d25b1-da49-4206-91d5-97248bdc4bcc None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:43.781484 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:43.814663 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5050a55-b218-4259-839c-b9e1897fdf6e None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:43.860935 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3272cc4d-6d66-434e-98af-a227f387bbd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:43.861602 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272cc4d-6d66-434e-98af-a227f387bbd2 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:43.861885 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272cc4d-6d66-434e-98af-a227f387bbd2 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:43.862161 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3272cc4d-6d66-434e-98af-a227f387bbd2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:43.863015 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272cc4d-6d66-434e-98af-a227f387bbd2 None admin] RBAC: Adding query filter params (role.id=5614294f6ab949a99424ee6e983b6430, user.id=572b6b6b9aaf446693b9e7ae0691539a, scope.system=all) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:43.863326 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272cc4d-6d66-434e-98af-a227f387bbd2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:43.865497 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3272cc4d-6d66-434e-98af-a227f387bbd2 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:43.872092 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 150/283] 10.222.0.62 () {56 vars in 1308 bytes} [Wed May 25 15:38:43 2022] GET /identity/v3/role_assignments?user.id=572b6b6b9aaf446693b9e7ae0691539a&scope.system=all&role.id=5614294f6ab949a99424ee6e983b6430 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:43.873404 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53237a91-7bd6-4657-8002-ab2c3ff83711 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:43.873747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53237a91-7bd6-4657-8002-ab2c3ff83711 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:43.873973 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53237a91-7bd6-4657-8002-ab2c3ff83711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:43.907205 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-53237a91-7bd6-4657-8002-ab2c3ff83711 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:43.907413 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d25b1-da49-4206-91d5-97248bdc4bcc None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:43.909509 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-53237a91-7bd6-4657-8002-ab2c3ff83711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:43.954911 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c2d54-05e6-42f2-9949-958b5846a93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:43.956056 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c2d54-05e6-42f2-9949-958b5846a93d None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:43.956693 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c2d54-05e6-42f2-9949-958b5846a93d None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:43.957277 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71c2d54-05e6-42f2-9949-958b5846a93d None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:43.958320 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c2d54-05e6-42f2-9949-958b5846a93d None admin] RBAC: Adding query filter params (name=reader) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:43.958876 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c2d54-05e6-42f2-9949-958b5846a93d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:43.962273 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71c2d54-05e6-42f2-9949-958b5846a93d None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:43.974251 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 134/284] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:43.982782 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c2d54-05e6-42f2-9949-958b5846a93d None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:44.005649 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:44.013661 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 151/285] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:44.049563 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53237a91-7bd6-4657-8002-ab2c3ff83711 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:44.103971 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:44.134891 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71c2d54-05e6-42f2-9949-958b5846a93d None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:44.188743 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38e072-a10e-4eff-90dd-0eb34e9a2572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:44.190655 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38e072-a10e-4eff-90dd-0eb34e9a2572 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:44.191465 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38e072-a10e-4eff-90dd-0eb34e9a2572 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:44.191949 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb38e072-a10e-4eff-90dd-0eb34e9a2572 None admin] PATH_INFO: `/v3/users/eae6079307bb43fa8fbcbbad5b839cfc` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:44.194265 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38e072-a10e-4eff-90dd-0eb34e9a2572 None admin] RBAC: Authorizing `identity:get_user(user_id=eae6079307bb43fa8fbcbbad5b839cfc)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:44.196558 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb38e072-a10e-4eff-90dd-0eb34e9a2572 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:44.199986 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 135/286] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:43 2022] GET /identity/v3/users/eae6079307bb43fa8fbcbbad5b839cfc => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:44.203675 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53237a91-7bd6-4657-8002-ab2c3ff83711 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:44.206745 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38e072-a10e-4eff-90dd-0eb34e9a2572 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:44.259977 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68c978-b023-424a-ad76-b0bb76e254db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:44.261216 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68c978-b023-424a-ad76-b0bb76e254db None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:44.261706 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68c978-b023-424a-ad76-b0bb76e254db None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:44.262189 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f68c978-b023-424a-ad76-b0bb76e254db None admin] PATH_INFO: `/v3/roles/member` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:44.277693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f68c978-b023-424a-ad76-b0bb76e254db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:44.287887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-7f68c978-b023-424a-ad76-b0bb76e254db None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:44.287887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:44.287887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:44.287887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:44.287887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:44.287887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:44.287887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:44.287887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:44.287887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:44.287887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:44.287887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:44.287887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:44.287887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:44.287887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:44.287887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:44.287887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:44.288898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:44.288898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:44.288898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:44.288898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:44.288898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:44.288898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:44.288898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:44.288898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:44.288898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:44.288898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:44.288898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:44.288898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:44.288898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:44.288898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:44.288898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:44.288898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:44.289698 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:44.289698 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:44.289698 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:44.289698 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:44.289698 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:44.289698 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:44.289698 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:44.289698 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:44.289698 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:44.289698 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:44.289698 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:44.289698 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:44.292684 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 152/287] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:38:44.300135 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68c978-b023-424a-ad76-b0bb76e254db None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:44.382380 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb38e072-a10e-4eff-90dd-0eb34e9a2572 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:44.425734 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:44.449079 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d05f7-364f-4175-8072-7dd1fc602281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:44.449968 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d05f7-364f-4175-8072-7dd1fc602281 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:44.450256 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d05f7-364f-4175-8072-7dd1fc602281 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:44.450534 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8d05f7-364f-4175-8072-7dd1fc602281 None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:44.451785 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d05f7-364f-4175-8072-7dd1fc602281 None admin] RBAC: Authorizing `identity:get_project(project_id=8c22dbab894644ce84024119b5b8a26c)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:44.454073 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8d05f7-364f-4175-8072-7dd1fc602281 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:44.456246 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 136/288] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:44 2022] GET /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c => generated 302 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:44.461471 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d05f7-364f-4175-8072-7dd1fc602281 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:44.492084 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:44.504499 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f68c978-b023-424a-ad76-b0bb76e254db None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:44.562936 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7dd52-6c04-4f76-8d06-d4b0cd2b7ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:44.566473 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7dd52-6c04-4f76-8d06-d4b0cd2b7ddb None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:44.566949 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7dd52-6c04-4f76-8d06-d4b0cd2b7ddb None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:44.567395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7dd52-6c04-4f76-8d06-d4b0cd2b7ddb None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:44.570267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7dd52-6c04-4f76-8d06-d4b0cd2b7ddb None admin] RBAC: Adding query filter params (name=member) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:44.571688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7dd52-6c04-4f76-8d06-d4b0cd2b7ddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:44.578094 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7dd52-6c04-4f76-8d06-d4b0cd2b7ddb None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:44.598238 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 153/289] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:44.605592 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7dd52-6c04-4f76-8d06-d4b0cd2b7ddb None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:44.691746 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8d05f7-364f-4175-8072-7dd1fc602281 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:44.740015 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e0fea-bc5c-4fa0-b9d1-31ecee6a74cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:44.742148 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e0fea-bc5c-4fa0-b9d1-31ecee6a74cd None admin] REQUEST_METHOD: `PUT` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:44.745832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e0fea-bc5c-4fa0-b9d1-31ecee6a74cd None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:44.746278 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6e0fea-bc5c-4fa0-b9d1-31ecee6a74cd None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c/users/eae6079307bb43fa8fbcbbad5b839cfc/roles/29ddb77b56f449aa87fa909f2eebe434` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:44.748656 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e0fea-bc5c-4fa0-b9d1-31ecee6a74cd None admin] RBAC: Authorizing `identity:create_grant(project_id=8c22dbab894644ce84024119b5b8a26c, user_id=eae6079307bb43fa8fbcbbad5b839cfc, role_id=29ddb77b56f449aa87fa909f2eebe434)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:44.751836 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6e0fea-bc5c-4fa0-b9d1-31ecee6a74cd None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:44.822987 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7dd52-6c04-4f76-8d06-d4b0cd2b7ddb None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:44.832719 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 137/290] 10.222.0.62 () {58 vars in 1439 bytes} [Wed May 25 15:38:44 2022] PUT /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c/users/eae6079307bb43fa8fbcbbad5b839cfc/roles/29ddb77b56f449aa87fa909f2eebe434 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:38:44.846900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:44.872008 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960fe82-7261-4405-b35f-5b1baef9233d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:44.873487 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960fe82-7261-4405-b35f-5b1baef9233d None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:44.873991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960fe82-7261-4405-b35f-5b1baef9233d None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:44.875075 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960fe82-7261-4405-b35f-5b1baef9233d None admin] PATH_INFO: `/v3/users/7ab7857ccef34f8baf8d94c931f8f325` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:44.878369 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960fe82-7261-4405-b35f-5b1baef9233d None admin] RBAC: Authorizing `identity:get_user(user_id=7ab7857ccef34f8baf8d94c931f8f325)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:44.880813 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960fe82-7261-4405-b35f-5b1baef9233d None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:44.883705 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 154/291] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:44 2022] GET /identity/v3/users/7ab7857ccef34f8baf8d94c931f8f325 => generated 297 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:44.889989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e0fea-bc5c-4fa0-b9d1-31ecee6a74cd None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:45.021113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:45.067609 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6e0fea-bc5c-4fa0-b9d1-31ecee6a74cd None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:45.126952 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bee7b-8b4c-44f9-a2e5-31f3c15ae9af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:45.127596 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bee7b-8b4c-44f9-a2e5-31f3c15ae9af None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:45.127879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bee7b-8b4c-44f9-a2e5-31f3c15ae9af None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:45.128155 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874bee7b-8b4c-44f9-a2e5-31f3c15ae9af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:45.218045 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874bee7b-8b4c-44f9-a2e5-31f3c15ae9af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:45.220039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874bee7b-8b4c-44f9-a2e5-31f3c15ae9af None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:45.308123 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:45.346393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 138/292] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:45.352364 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960fe82-7261-4405-b35f-5b1baef9233d None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:45.515469 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960fe82-7261-4405-b35f-5b1baef9233d None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:45.563774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2a4f8-dce5-42f3-9930-ee11c9f3783c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:45.564667 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2a4f8-dce5-42f3-9930-ee11c9f3783c None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:45.564946 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2a4f8-dce5-42f3-9930-ee11c9f3783c None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:45.565358 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2a4f8-dce5-42f3-9930-ee11c9f3783c None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:45.566592 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2a4f8-dce5-42f3-9930-ee11c9f3783c None admin] RBAC: Authorizing `identity:get_project(project_id=8c22dbab894644ce84024119b5b8a26c)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:45.568045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2a4f8-dce5-42f3-9930-ee11c9f3783c None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:45.569938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 155/293] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:45 2022] GET /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c => generated 302 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:45.576020 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bee7b-8b4c-44f9-a2e5-31f3c15ae9af None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:45.743670 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874bee7b-8b4c-44f9-a2e5-31f3c15ae9af None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:45.797706 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8177518-0636-4ad7-b24e-4dc6ce7d86ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:45.798294 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8177518-0636-4ad7-b24e-4dc6ce7d86ca None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:45.798581 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8177518-0636-4ad7-b24e-4dc6ce7d86ca None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:45.798858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8177518-0636-4ad7-b24e-4dc6ce7d86ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:45.799687 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8177518-0636-4ad7-b24e-4dc6ce7d86ca None admin] RBAC: Adding query filter params (role.id=5614294f6ab949a99424ee6e983b6430, scope.project.id=8c22dbab894644ce84024119b5b8a26c, user.id=7ab7857ccef34f8baf8d94c931f8f325) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:45.800001 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8177518-0636-4ad7-b24e-4dc6ce7d86ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:45.801476 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8177518-0636-4ad7-b24e-4dc6ce7d86ca None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:45.809503 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 139/294] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:38:45 2022] GET /identity/v3/role_assignments?user.id=7ab7857ccef34f8baf8d94c931f8f325&scope.project.id=8c22dbab894644ce84024119b5b8a26c&role.id=5614294f6ab949a99424ee6e983b6430 => generated 608 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:46.532943 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c48a9-0bc1-42e3-8d83-b6f4944b1fbf None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:46.533437 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c48a9-0bc1-42e3-8d83-b6f4944b1fbf None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:46.533437 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305c48a9-0bc1-42e3-8d83-b6f4944b1fbf None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:46.534785 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 156/295] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:46.540368 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f507d09-f5eb-44c4-9bc8-ef8b70607767 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:46.540865 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f507d09-f5eb-44c4-9bc8-ef8b70607767 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:46.540940 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f507d09-f5eb-44c4-9bc8-ef8b70607767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:46.560559 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-1f507d09-f5eb-44c4-9bc8-ef8b70607767 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:46.561854 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-1f507d09-f5eb-44c4-9bc8-ef8b70607767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:46.596387 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:46.651301 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 140/296] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:38:46.676678 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c48a9-0bc1-42e3-8d83-b6f4944b1fbf None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:46.741001 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:46.791891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305c48a9-0bc1-42e3-8d83-b6f4944b1fbf None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:46.829749 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afda319-6ae7-4f38-822c-de74a7f3e4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:46.831016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afda319-6ae7-4f38-822c-de74a7f3e4e2 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:46.831447 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afda319-6ae7-4f38-822c-de74a7f3e4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:46.831904 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afda319-6ae7-4f38-822c-de74a7f3e4e2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:46.850215 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afda319-6ae7-4f38-822c-de74a7f3e4e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:46.858143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-7afda319-6ae7-4f38-822c-de74a7f3e4e2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:38:46.858143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:46.858143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:46.858143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:46.858143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:46.858143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:46.858143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:46.858143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:46.858143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:46.858143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:46.858143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:46.858143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:46.858143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:46.858143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:46.858143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:46.858143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:46.859891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:46.859891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:46.859891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:46.859891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:46.859891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:46.859891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:46.859891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:46.859891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:46.859891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:46.859891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:46.859891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:46.859891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:46.859891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:46.859891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:46.859891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:46.859891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:46.861498 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:46.861498 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:46.861498 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:46.861498 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:46.861498 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:46.861498 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:46.861498 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:46.861498 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:46.861498 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:46.861498 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:46.861498 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:38:46.861498 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:46.861498 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 157/297] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:46.869410 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f507d09-f5eb-44c4-9bc8-ef8b70607767 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:46.887966 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f877a6-57d5-4739-99b1-05625473266e None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:46.888996 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f877a6-57d5-4739-99b1-05625473266e None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:46.890589 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f877a6-57d5-4739-99b1-05625473266e None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:46.892962 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 158/298] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:46.901017 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec22f0-36b9-40a0-8919-5d5ef3f1926c None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:46.901747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec22f0-36b9-40a0-8919-5d5ef3f1926c None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:46.902248 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ec22f0-36b9-40a0-8919-5d5ef3f1926c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:46.924460 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-d5ec22f0-36b9-40a0-8919-5d5ef3f1926c None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:46.926353 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-d5ec22f0-36b9-40a0-8919-5d5ef3f1926c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:46.990598 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f507d09-f5eb-44c4-9bc8-ef8b70607767 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:47.012516 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 159/299] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:47.012516 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c81a9-ab3e-403b-b78b-f701bf35f18f None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:47.012516 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c81a9-ab3e-403b-b78b-f701bf35f18f None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:47.012516 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0c81a9-ab3e-403b-b78b-f701bf35f18f None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:47.016870 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 160/300] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:47.028442 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1ced9-0ad3-47b3-8ccb-fba6ab299e54 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:47.028442 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1ced9-0ad3-47b3-8ccb-fba6ab299e54 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:47.028442 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1ced9-0ad3-47b3-8ccb-fba6ab299e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:47.035606 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e87b3d-a6d0-4aae-ab4d-19f3658502ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:47.036591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e87b3d-a6d0-4aae-ab4d-19f3658502ff None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:47.036879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e87b3d-a6d0-4aae-ab4d-19f3658502ff None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:47.037154 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e87b3d-a6d0-4aae-ab4d-19f3658502ff None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:47.037908 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e87b3d-a6d0-4aae-ab4d-19f3658502ff None admin] RBAC: Adding query filter params (name=reader) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:47.038218 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e87b3d-a6d0-4aae-ab4d-19f3658502ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:47.039609 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e87b3d-a6d0-4aae-ab4d-19f3658502ff None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:47.044816 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-4de1ced9-0ad3-47b3-8ccb-fba6ab299e54 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:47.047503 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-4de1ced9-0ad3-47b3-8ccb-fba6ab299e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:47.049658 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 141/301] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:47.056264 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e87b3d-a6d0-4aae-ab4d-19f3658502ff None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:47.096207 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:47.110353 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:47.149404 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 161/302] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:47.150619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1ced9-0ad3-47b3-8ccb-fba6ab299e54 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:47.250009 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e87b3d-a6d0-4aae-ab4d-19f3658502ff None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:47.295439 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb44d7-e38d-4818-81df-72bb103cb18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:47.297147 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb44d7-e38d-4818-81df-72bb103cb18f None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:47.297623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb44d7-e38d-4818-81df-72bb103cb18f None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:47.298069 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb44d7-e38d-4818-81df-72bb103cb18f None admin] PATH_INFO: `/v3/domains/default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:47.299795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb44d7-e38d-4818-81df-72bb103cb18f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:47.301497 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb44d7-e38d-4818-81df-72bb103cb18f None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:47.303802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 142/303] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:38:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:47.304901 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb44d7-e38d-4818-81df-72bb103cb18f None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:47.316918 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1ced9-0ad3-47b3-8ccb-fba6ab299e54 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:47.368091 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d430d5e-3aef-4cfa-b185-69b44fb6b09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:47.369255 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d430d5e-3aef-4cfa-b185-69b44fb6b09d None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:47.369686 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d430d5e-3aef-4cfa-b185-69b44fb6b09d None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:47.370105 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d430d5e-3aef-4cfa-b185-69b44fb6b09d None admin] PATH_INFO: `/v3/users/b62134dbb1fd4abb80bc6cd18c442ee2` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:47.387351 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d430d5e-3aef-4cfa-b185-69b44fb6b09d None admin] RBAC: Authorizing `identity:get_user(user_id=b62134dbb1fd4abb80bc6cd18c442ee2)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:47.392217 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d430d5e-3aef-4cfa-b185-69b44fb6b09d None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:47.395232 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 162/304] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:47 2022] GET /identity/v3/users/b62134dbb1fd4abb80bc6cd18c442ee2 => generated 293 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:47.396429 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d430d5e-3aef-4cfa-b185-69b44fb6b09d None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:47.432864 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:47.440955 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb44d7-e38d-4818-81df-72bb103cb18f None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:47.459113 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:47.495330 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59feac-ef3e-4251-8ddf-bfb8eb14e3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:47.496427 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59feac-ef3e-4251-8ddf-bfb8eb14e3aa None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:47.496741 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59feac-ef3e-4251-8ddf-bfb8eb14e3aa None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:47.497186 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d59feac-ef3e-4251-8ddf-bfb8eb14e3aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:47.519181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d59feac-ef3e-4251-8ddf-bfb8eb14e3aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:47.532485 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-2d59feac-ef3e-4251-8ddf-bfb8eb14e3aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:47.532485 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:47.532485 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:47.532485 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:47.532485 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:47.532485 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:47.532485 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:47.532485 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:47.532485 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:47.532485 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:47.532485 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:47.532485 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:47.532485 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:47.532485 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:47.532485 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:47.532485 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:47.533576 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:47.533576 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:47.533576 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:47.533576 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:47.533576 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:47.533576 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:47.533576 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:47.533576 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:47.533576 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:47.533576 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:47.533576 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:47.533576 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:38:47.533576 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:47.533576 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:47.533576 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:47.533576 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:47.534360 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:47.534360 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:47.534360 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:47.534360 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:47.534360 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:47.534360 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:47.534360 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:47.534360 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:47.534360 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:47.534360 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:47.534360 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:47.534360 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:38:47.534999 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 143/305] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:47.535918 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59feac-ef3e-4251-8ddf-bfb8eb14e3aa None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:47.570386 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d430d5e-3aef-4cfa-b185-69b44fb6b09d None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:47.614423 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff68b8c-85f4-4921-bb52-33d18c4c89cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:47.615177 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff68b8c-85f4-4921-bb52-33d18c4c89cc None admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:47.615393 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff68b8c-85f4-4921-bb52-33d18c4c89cc None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:47.615678 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff68b8c-85f4-4921-bb52-33d18c4c89cc None admin] PATH_INFO: `/v3/groups` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:47.616371 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff68b8c-85f4-4921-bb52-33d18c4c89cc None admin] RBAC: Authorizing `identity:create_group()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:47.617897 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff68b8c-85f4-4921-bb52-33d18c4c89cc None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:47.660821 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d59feac-ef3e-4251-8ddf-bfb8eb14e3aa None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:47.696098 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc24f4-6b6a-46ed-b13a-824fd035c3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:47.696784 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc24f4-6b6a-46ed-b13a-824fd035c3fd None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:47.697067 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc24f4-6b6a-46ed-b13a-824fd035c3fd None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:47.697340 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdc24f4-6b6a-46ed-b13a-824fd035c3fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:47.698195 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc24f4-6b6a-46ed-b13a-824fd035c3fd None admin] RBAC: Adding query filter params (role.id=29ddb77b56f449aa87fa909f2eebe434, user.id=b62134dbb1fd4abb80bc6cd18c442ee2, scope.system=all) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:47.698508 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc24f4-6b6a-46ed-b13a-824fd035c3fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:47.699960 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdc24f4-6b6a-46ed-b13a-824fd035c3fd None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:47.706133 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 144/306] 10.222.0.62 () {56 vars in 1308 bytes} [Wed May 25 15:38:47 2022] GET /identity/v3/role_assignments?user.id=b62134dbb1fd4abb80bc6cd18c442ee2&scope.system=all&role.id=29ddb77b56f449aa87fa909f2eebe434 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:47.706966 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc24f4-6b6a-46ed-b13a-824fd035c3fd None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:47.713776 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 163/307] 10.222.0.62 () {60 vars in 1134 bytes} [Wed May 25 15:38:47 2022] POST /identity/v3/groups => generated 229 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:38:47.715435 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb856c-a97e-47d8-81d9-139e7503f50f None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:47.715581 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb856c-a97e-47d8-81d9-139e7503f50f None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:47.715927 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb856c-a97e-47d8-81d9-139e7503f50f None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:47.722647 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 164/308] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:47.724513 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104056c-c5ec-4472-aa0e-df825bdfc165 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:47.725003 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104056c-c5ec-4472-aa0e-df825bdfc165 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:47.725386 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104056c-c5ec-4472-aa0e-df825bdfc165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:47.745538 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-5104056c-c5ec-4472-aa0e-df825bdfc165 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:47.747026 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-5104056c-c5ec-4472-aa0e-df825bdfc165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:47.756045 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:47.876573 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdc24f4-6b6a-46ed-b13a-824fd035c3fd None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:47.877182 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 165/309] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:47.904682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104056c-c5ec-4472-aa0e-df825bdfc165 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:47.932342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98d134-59c3-4038-81b7-13afeb8dfaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:47.933981 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98d134-59c3-4038-81b7-13afeb8dfaa5 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:47.934262 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98d134-59c3-4038-81b7-13afeb8dfaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:47.934714 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b98d134-59c3-4038-81b7-13afeb8dfaa5 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:47.935480 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98d134-59c3-4038-81b7-13afeb8dfaa5 None admin] RBAC: Adding query filter params (name=member) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:47.935792 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98d134-59c3-4038-81b7-13afeb8dfaa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:47.937941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b98d134-59c3-4038-81b7-13afeb8dfaa5 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:47.941046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:47.949160 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 145/310] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:47.958426 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98d134-59c3-4038-81b7-13afeb8dfaa5 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:48.053425 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5104056c-c5ec-4472-aa0e-df825bdfc165 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:48.098878 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9abe26-f221-43e7-9633-d137f0c77a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:48.099691 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9abe26-f221-43e7-9633-d137f0c77a02 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:48.099969 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9abe26-f221-43e7-9633-d137f0c77a02 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:48.100242 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9abe26-f221-43e7-9633-d137f0c77a02 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:48.115050 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9abe26-f221-43e7-9633-d137f0c77a02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:48.123255 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-bd9abe26-f221-43e7-9633-d137f0c77a02 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:38:48.123255 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:48.123255 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:48.123255 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:48.123255 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:48.123255 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:48.123255 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:48.123255 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:48.123255 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:48.123255 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:48.123255 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:48.123255 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:48.123255 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:48.123255 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:48.123255 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:48.123255 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:48.125688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:48.125688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:48.125688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:48.125688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:48.125688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:48.125688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:48.125688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:48.125688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:48.125688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:48.125688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:48.125688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:48.125688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:48.125688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:48.125688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:48.125688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:48.125688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:48.127613 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:48.127613 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:48.127613 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:48.127613 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:48.127613 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:48.127613 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:48.127613 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:48.127613 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:48.127613 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:48.127613 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:48.127613 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:38:48.127613 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:48.127613 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 166/311] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:38:48.131363 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:48.135737 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9abe26-f221-43e7-9633-d137f0c77a02 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:48.168112 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b98d134-59c3-4038-81b7-13afeb8dfaa5 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:48.214322 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147a6b1-10fe-468b-adfc-34d86d57bad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:48.215223 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147a6b1-10fe-468b-adfc-34d86d57bad1 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:48.215512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147a6b1-10fe-468b-adfc-34d86d57bad1 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:48.215961 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4147a6b1-10fe-468b-adfc-34d86d57bad1 None admin] PATH_INFO: `/v3/users/572b6b6b9aaf446693b9e7ae0691539a` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:48.217708 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147a6b1-10fe-468b-adfc-34d86d57bad1 None admin] RBAC: Authorizing `identity:get_user(user_id=572b6b6b9aaf446693b9e7ae0691539a)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:48.219296 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4147a6b1-10fe-468b-adfc-34d86d57bad1 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:48.222090 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 146/312] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:47 2022] GET /identity/v3/users/572b6b6b9aaf446693b9e7ae0691539a => generated 293 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:48.228189 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147a6b1-10fe-468b-adfc-34d86d57bad1 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:48.268774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:48.314061 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9abe26-f221-43e7-9633-d137f0c77a02 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:48.364935 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416e2f0-47b7-4d32-a912-766a56c30dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:48.365924 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416e2f0-47b7-4d32-a912-766a56c30dcb None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:48.366493 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416e2f0-47b7-4d32-a912-766a56c30dcb None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:48.366911 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4416e2f0-47b7-4d32-a912-766a56c30dcb None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:48.367939 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416e2f0-47b7-4d32-a912-766a56c30dcb None admin] RBAC: Adding query filter params (name=reader) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:48.368795 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416e2f0-47b7-4d32-a912-766a56c30dcb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:48.370525 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4416e2f0-47b7-4d32-a912-766a56c30dcb None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:48.373100 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4147a6b1-10fe-468b-adfc-34d86d57bad1 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:48.383166 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 167/313] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:48.394902 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416e2f0-47b7-4d32-a912-766a56c30dcb None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:48.444555 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09ea5c-f139-4ef7-972b-d80991c6840b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:48.446530 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09ea5c-f139-4ef7-972b-d80991c6840b None admin] REQUEST_METHOD: `PUT` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:48.446888 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09ea5c-f139-4ef7-972b-d80991c6840b None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:48.447248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d09ea5c-f139-4ef7-972b-d80991c6840b None admin] PATH_INFO: `/v3/system/users/572b6b6b9aaf446693b9e7ae0691539a/roles/5614294f6ab949a99424ee6e983b6430` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:48.448981 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09ea5c-f139-4ef7-972b-d80991c6840b None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=572b6b6b9aaf446693b9e7ae0691539a, role_id=5614294f6ab949a99424ee6e983b6430)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:48.450466 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d09ea5c-f139-4ef7-972b-d80991c6840b None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:48.529512 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4416e2f0-47b7-4d32-a912-766a56c30dcb None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:48.581126 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d4efd-e0f4-4ef0-9f18-5ccb87c6dd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:48.583069 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d4efd-e0f4-4ef0-9f18-5ccb87c6dd69 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:48.583535 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d4efd-e0f4-4ef0-9f18-5ccb87c6dd69 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:48.584050 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d4efd-e0f4-4ef0-9f18-5ccb87c6dd69 None admin] PATH_INFO: `/v3/users/eae6079307bb43fa8fbcbbad5b839cfc` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:48.584512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 147/314] 10.222.0.62 () {58 vars in 1334 bytes} [Wed May 25 15:38:48 2022] PUT /identity/v3/system/users/572b6b6b9aaf446693b9e7ae0691539a/roles/5614294f6ab949a99424ee6e983b6430 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:38:48.586154 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d4efd-e0f4-4ef0-9f18-5ccb87c6dd69 None admin] RBAC: Authorizing `identity:get_user(user_id=eae6079307bb43fa8fbcbbad5b839cfc)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:48.587948 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d4efd-e0f4-4ef0-9f18-5ccb87c6dd69 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:48.595333 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 168/315] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:48 2022] GET /identity/v3/users/eae6079307bb43fa8fbcbbad5b839cfc => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:48.596638 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09ea5c-f139-4ef7-972b-d80991c6840b None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:48.621553 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:48.742982 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d09ea5c-f139-4ef7-972b-d80991c6840b None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:48.785270 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a21c2-aceb-445c-9eba-0d2a486ad5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:48.785943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a21c2-aceb-445c-9eba-0d2a486ad5d5 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:48.786260 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a21c2-aceb-445c-9eba-0d2a486ad5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:48.786612 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a21c2-aceb-445c-9eba-0d2a486ad5d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:48.867526 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a21c2-aceb-445c-9eba-0d2a486ad5d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:48.869105 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a21c2-aceb-445c-9eba-0d2a486ad5d5 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:48.885568 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:48.990964 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 148/316] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:48.996783 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d4efd-e0f4-4ef0-9f18-5ccb87c6dd69 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:49.016665 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:49.133977 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d4efd-e0f4-4ef0-9f18-5ccb87c6dd69 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:49.175553 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc79709-6781-4fa9-9c64-3b0bbebeec74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:49.176557 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc79709-6781-4fa9-9c64-3b0bbebeec74 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:49.176859 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc79709-6781-4fa9-9c64-3b0bbebeec74 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:49.177342 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc79709-6781-4fa9-9c64-3b0bbebeec74 None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:49.178795 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc79709-6781-4fa9-9c64-3b0bbebeec74 None admin] RBAC: Authorizing `identity:get_project(project_id=8c22dbab894644ce84024119b5b8a26c)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:49.180443 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc79709-6781-4fa9-9c64-3b0bbebeec74 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:49.182402 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 169/317] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:48 2022] GET /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:49.189838 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a21c2-aceb-445c-9eba-0d2a486ad5d5 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:49.303304 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a21c2-aceb-445c-9eba-0d2a486ad5d5 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:49.322319 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:49.343603 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2b392-fc35-4616-b4ad-5d2a05f14e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:49.344269 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2b392-fc35-4616-b4ad-5d2a05f14e06 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:49.344579 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2b392-fc35-4616-b4ad-5d2a05f14e06 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:49.344858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2b392-fc35-4616-b4ad-5d2a05f14e06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:49.345884 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2b392-fc35-4616-b4ad-5d2a05f14e06 None admin] RBAC: Adding query filter params (role.id=29ddb77b56f449aa87fa909f2eebe434, scope.project.id=8c22dbab894644ce84024119b5b8a26c, user.id=eae6079307bb43fa8fbcbbad5b839cfc) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:49.346202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2b392-fc35-4616-b4ad-5d2a05f14e06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:49.347652 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2b392-fc35-4616-b4ad-5d2a05f14e06 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:49.354354 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 149/318] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:38:49 2022] GET /identity/v3/role_assignments?user.id=eae6079307bb43fa8fbcbbad5b839cfc&scope.project.id=8c22dbab894644ce84024119b5b8a26c&role.id=29ddb77b56f449aa87fa909f2eebe434 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:50.136391 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6bf93-5f1a-4374-9934-b26e92254e68 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:50.136962 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6bf93-5f1a-4374-9934-b26e92254e68 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:50.137040 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f6bf93-5f1a-4374-9934-b26e92254e68 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:50.138703 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 170/319] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:50.145385 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9baedd-6560-45c5-a348-b430d23c16c9 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:50.145876 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9baedd-6560-45c5-a348-b430d23c16c9 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:50.145952 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9baedd-6560-45c5-a348-b430d23c16c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:50.164807 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-0f9baedd-6560-45c5-a348-b430d23c16c9 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:50.166041 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-0f9baedd-6560-45c5-a348-b430d23c16c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:50.249018 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 150/320] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:50.274236 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6bf93-5f1a-4374-9934-b26e92254e68 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:50.306969 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987f777-9c33-45b1-94c7-35266e99b226 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:50.307278 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987f777-9c33-45b1-94c7-35266e99b226 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:50.307594 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8987f777-9c33-45b1-94c7-35266e99b226 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:50.309191 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 151/321] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:50.315061 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8ca0e-ba49-4915-aaf4-35391765bee1 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:50.315350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8ca0e-ba49-4915-aaf4-35391765bee1 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:50.315630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c8ca0e-ba49-4915-aaf4-35391765bee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:50.332995 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-c3c8ca0e-ba49-4915-aaf4-35391765bee1 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:50.334211 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-c3c8ca0e-ba49-4915-aaf4-35391765bee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:50.369461 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:50.392292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f6bf93-5f1a-4374-9934-b26e92254e68 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:50.414337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 152/322] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:38:50.436344 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07d7ec-a10f-4a5e-aacc-309fa9382178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:50.438294 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8ca0e-ba49-4915-aaf4-35391765bee1 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:50.438486 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07d7ec-a10f-4a5e-aacc-309fa9382178 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:50.438769 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07d7ec-a10f-4a5e-aacc-309fa9382178 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:50.439044 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff07d7ec-a10f-4a5e-aacc-309fa9382178 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:50.453019 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff07d7ec-a10f-4a5e-aacc-309fa9382178 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:50.461528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-ff07d7ec-a10f-4a5e-aacc-309fa9382178 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:38:50.461528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:50.461528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:50.461528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:50.461528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:50.461528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:50.461528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:50.461528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:50.461528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:50.461528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:50.461528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:50.461528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:50.461528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:50.461528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:50.461528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:50.461528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:50.462518 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:50.462518 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:50.462518 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:50.462518 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:50.462518 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:50.462518 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:50.462518 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:50.462518 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:50.462518 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:50.462518 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:50.462518 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:50.462518 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:50.462518 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:50.462518 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:50.462518 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:50.462518 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:50.463682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:50.463682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:50.463682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:50.463682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:50.463682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:50.463682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:50.463682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:50.463682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:50.463682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:50.463682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:50.463682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:38:50.463682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:50.463682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 171/323] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:50.469462 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07d7ec-a10f-4a5e-aacc-309fa9382178 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:50.484390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:50.554585 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c8ca0e-ba49-4915-aaf4-35391765bee1 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:50.586907 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff07d7ec-a10f-4a5e-aacc-309fa9382178 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:50.595360 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec5adc-8ca8-44bb-8c05-af97127762d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:50.596166 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec5adc-8ca8-44bb-8c05-af97127762d8 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:50.596474 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec5adc-8ca8-44bb-8c05-af97127762d8 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:50.596760 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ec5adc-8ca8-44bb-8c05-af97127762d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:50.598266 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec5adc-8ca8-44bb-8c05-af97127762d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:50.599613 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ec5adc-8ca8-44bb-8c05-af97127762d8 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:50.607275 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 153/324] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:38:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:50.608287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec5adc-8ca8-44bb-8c05-af97127762d8 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:50.632723 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8ac9f-a5d6-4b1c-b1a8-288d70bbe83d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:50.633410 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8ac9f-a5d6-4b1c-b1a8-288d70bbe83d None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:50.633697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8ac9f-a5d6-4b1c-b1a8-288d70bbe83d None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:50.633976 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8ac9f-a5d6-4b1c-b1a8-288d70bbe83d None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:50.634732 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8ac9f-a5d6-4b1c-b1a8-288d70bbe83d None admin] RBAC: Adding query filter params (name=reader) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:50.635042 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8ac9f-a5d6-4b1c-b1a8-288d70bbe83d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:50.636601 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8ac9f-a5d6-4b1c-b1a8-288d70bbe83d None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:50.646629 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 172/325] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:50.653691 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8ac9f-a5d6-4b1c-b1a8-288d70bbe83d None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:50.657950 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:50.735452 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ec5adc-8ca8-44bb-8c05-af97127762d8 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:50.743570 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:50.774065 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0506d24c-c12a-4c52-b4ea-504154753e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:50.774838 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506d24c-c12a-4c52-b4ea-504154753e94 None admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:50.775017 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506d24c-c12a-4c52-b4ea-504154753e94 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:50.775294 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0506d24c-c12a-4c52-b4ea-504154753e94 None admin] PATH_INFO: `/v3/groups` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:50.775983 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506d24c-c12a-4c52-b4ea-504154753e94 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:50.777458 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0506d24c-c12a-4c52-b4ea-504154753e94 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:50.785050 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8ac9f-a5d6-4b1c-b1a8-288d70bbe83d None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:50.820320 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14299bdc-8750-4566-af90-b68a83eff1d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:50.821289 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14299bdc-8750-4566-af90-b68a83eff1d8 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:50.821571 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14299bdc-8750-4566-af90-b68a83eff1d8 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:50.821845 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14299bdc-8750-4566-af90-b68a83eff1d8 None admin] PATH_INFO: `/v3/users/b62134dbb1fd4abb80bc6cd18c442ee2` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:50.823049 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14299bdc-8750-4566-af90-b68a83eff1d8 None admin] RBAC: Authorizing `identity:get_user(user_id=b62134dbb1fd4abb80bc6cd18c442ee2)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:50.824594 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14299bdc-8750-4566-af90-b68a83eff1d8 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:50.826199 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 173/326] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:50 2022] GET /identity/v3/users/b62134dbb1fd4abb80bc6cd18c442ee2 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:50.831736 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14299bdc-8750-4566-af90-b68a83eff1d8 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:50.916550 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 154/327] 10.222.0.62 () {60 vars in 1134 bytes} [Wed May 25 15:38:50 2022] POST /identity/v3/groups => generated 226 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:38:50.916782 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:50.958048 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14299bdc-8750-4566-af90-b68a83eff1d8 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:51.002881 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b20db-b4d2-4c46-935e-92d668f82139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:51.003955 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b20db-b4d2-4c46-935e-92d668f82139 None admin] REQUEST_METHOD: `PUT` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:51.004365 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b20db-b4d2-4c46-935e-92d668f82139 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:51.004851 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b20db-b4d2-4c46-935e-92d668f82139 None admin] PATH_INFO: `/v3/system/users/b62134dbb1fd4abb80bc6cd18c442ee2/roles/29ddb77b56f449aa87fa909f2eebe434` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:51.006860 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b20db-b4d2-4c46-935e-92d668f82139 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=b62134dbb1fd4abb80bc6cd18c442ee2, role_id=29ddb77b56f449aa87fa909f2eebe434)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:51.008556 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b20db-b4d2-4c46-935e-92d668f82139 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:51.095738 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 174/328] 10.222.0.62 () {58 vars in 1334 bytes} [Wed May 25 15:38:50 2022] PUT /identity/v3/system/users/b62134dbb1fd4abb80bc6cd18c442ee2/roles/29ddb77b56f449aa87fa909f2eebe434 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:38:51.106114 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3886a-a7d6-42e7-9d4e-07c7ad954b57 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:51.106114 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3886a-a7d6-42e7-9d4e-07c7ad954b57 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:51.106114 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3886a-a7d6-42e7-9d4e-07c7ad954b57 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:51.106114 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 155/329] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:51.113732 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367f689-4933-44ad-8a5e-19e9fc049151 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:51.114078 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367f689-4933-44ad-8a5e-19e9fc049151 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:51.114308 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c367f689-4933-44ad-8a5e-19e9fc049151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:51.133908 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-c367f689-4933-44ad-8a5e-19e9fc049151 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:51.135184 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-c367f689-4933-44ad-8a5e-19e9fc049151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:51.222197 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 175/330] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:51.250397 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3886a-a7d6-42e7-9d4e-07c7ad954b57 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:51.382349 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3886a-a7d6-42e7-9d4e-07c7ad954b57 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:51.421408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48a3a7-2ede-4abc-a3a7-44f2911b3764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:51.423298 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48a3a7-2ede-4abc-a3a7-44f2911b3764 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:51.423586 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48a3a7-2ede-4abc-a3a7-44f2911b3764 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:51.423871 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c48a3a7-2ede-4abc-a3a7-44f2911b3764 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:51.440366 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c48a3a7-2ede-4abc-a3a7-44f2911b3764 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:51.448660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-3c48a3a7-2ede-4abc-a3a7-44f2911b3764 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:51.448660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:51.448660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:51.448660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:51.448660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:51.448660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:51.448660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:51.448660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:51.448660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:51.448660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:51.448660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:51.448660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:51.448660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:51.448660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:51.448660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:51.448660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:51.449565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:51.449565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:51.449565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:51.449565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:51.449565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:51.449565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:51.449565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:51.449565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:51.449565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:51.449565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:51.449565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:51.449565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:38:51.449565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:51.449565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:51.449565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:51.449565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:51.450358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:51.450358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:51.450358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:51.450358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:51.450358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:51.450358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:51.450358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:51.450358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:51.450358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:51.450358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:51.450358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:51.450358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:38:51.450358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 156/331] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:51.456372 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367f689-4933-44ad-8a5e-19e9fc049151 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:51.539420 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:51.579154 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c367f689-4933-44ad-8a5e-19e9fc049151 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:51.621752 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b048f14-ece2-42a9-a21c-4205f15c31ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:51.622444 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b048f14-ece2-42a9-a21c-4205f15c31ae None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:51.622729 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b048f14-ece2-42a9-a21c-4205f15c31ae None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:51.623002 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b048f14-ece2-42a9-a21c-4205f15c31ae None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:51.623766 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b048f14-ece2-42a9-a21c-4205f15c31ae None admin] RBAC: Adding query filter params (name=member) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:51.624099 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b048f14-ece2-42a9-a21c-4205f15c31ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:51.626089 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b048f14-ece2-42a9-a21c-4205f15c31ae None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:51.637836 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 176/332] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:51.643642 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48a3a7-2ede-4abc-a3a7-44f2911b3764 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:51.687932 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:51.801657 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c48a3a7-2ede-4abc-a3a7-44f2911b3764 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:51.856591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4e5d54-22d4-4f25-9ec4-5e41de9fa72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:51.857491 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e5d54-22d4-4f25-9ec4-5e41de9fa72b None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:51.857772 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e5d54-22d4-4f25-9ec4-5e41de9fa72b None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:51.858048 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4e5d54-22d4-4f25-9ec4-5e41de9fa72b None admin] PATH_INFO: `/v3/users/572b6b6b9aaf446693b9e7ae0691539a` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:51.859382 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e5d54-22d4-4f25-9ec4-5e41de9fa72b None admin] RBAC: Authorizing `identity:get_user(user_id=572b6b6b9aaf446693b9e7ae0691539a)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:51.861101 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4e5d54-22d4-4f25-9ec4-5e41de9fa72b None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:51.863289 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 157/333] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:51 2022] GET /identity/v3/users/572b6b6b9aaf446693b9e7ae0691539a => generated 293 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:51.868808 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b048f14-ece2-42a9-a21c-4205f15c31ae None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:52.026922 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b048f14-ece2-42a9-a21c-4205f15c31ae None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:52.065345 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:52.080254 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b440d2d-816e-476a-a394-a77280b2d3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:52.080953 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b440d2d-816e-476a-a394-a77280b2d3b0 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:52.081524 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b440d2d-816e-476a-a394-a77280b2d3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:52.081524 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b440d2d-816e-476a-a394-a77280b2d3b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:52.088859 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b440d2d-816e-476a-a394-a77280b2d3b0 None admin] RBAC: Adding query filter params (role.id=5614294f6ab949a99424ee6e983b6430, user.id=572b6b6b9aaf446693b9e7ae0691539a, scope.system=all) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:52.088859 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b440d2d-816e-476a-a394-a77280b2d3b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:52.088859 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b440d2d-816e-476a-a394-a77280b2d3b0 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:52.103317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 177/334] 10.222.0.62 () {56 vars in 1308 bytes} [Wed May 25 15:38:51 2022] GET /identity/v3/role_assignments?user.id=572b6b6b9aaf446693b9e7ae0691539a&scope.system=all&role.id=5614294f6ab949a99424ee6e983b6430 => generated 510 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:53.900722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fd323-db5f-4b71-affe-43ebf21b44a4 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:53.901740 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fd323-db5f-4b71-affe-43ebf21b44a4 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:53.902222 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994fd323-db5f-4b71-affe-43ebf21b44a4 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:53.904095 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 158/335] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:53.910664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8df360-d4a3-4f1b-b015-8f5f5a2c6754 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:53.911560 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8df360-d4a3-4f1b-b015-8f5f5a2c6754 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:53.912030 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8df360-d4a3-4f1b-b015-8f5f5a2c6754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:53.936370 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-5f8df360-d4a3-4f1b-b015-8f5f5a2c6754 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:53.938010 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-5f8df360-d4a3-4f1b-b015-8f5f5a2c6754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:54.019879 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 178/336] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:38:54.045492 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fd323-db5f-4b71-affe-43ebf21b44a4 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:54.180905 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:54.194246 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994fd323-db5f-4b71-affe-43ebf21b44a4 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:54.245852 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feb2c16-67b1-40c7-ab42-22f975f2533a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:54.246759 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb2c16-67b1-40c7-ab42-22f975f2533a None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:54.247071 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb2c16-67b1-40c7-ab42-22f975f2533a None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:54.247424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feb2c16-67b1-40c7-ab42-22f975f2533a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:54.271030 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feb2c16-67b1-40c7-ab42-22f975f2533a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:54.283747 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-9feb2c16-67b1-40c7-ab42-22f975f2533a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:38:54.283747 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:54.283747 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:54.283747 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:54.283747 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:54.283747 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:54.283747 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:54.283747 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:54.283747 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:54.283747 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:54.283747 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:54.283747 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:54.283747 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:54.283747 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:54.283747 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:54.283747 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:54.284712 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:54.284712 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:54.284712 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:54.284712 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:54.284712 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:54.284712 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:54.284712 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:54.284712 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:54.284712 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:54.284712 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:54.284712 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:54.284712 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:38:54.284712 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:54.284712 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:54.284712 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:54.284712 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:54.285516 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:54.285516 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:54.285516 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:54.285516 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:54.285516 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:54.285516 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:54.285516 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:54.285516 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:54.285516 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:54.285516 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:54.285516 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 15:38:54.285516 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:38:54.285516 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 159/337] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:54.291141 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8df360-d4a3-4f1b-b015-8f5f5a2c6754 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:54.448525 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8df360-d4a3-4f1b-b015-8f5f5a2c6754 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:54.451187 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a46cc-0de9-4df1-9192-46afdd4b24af None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:54.451663 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a46cc-0de9-4df1-9192-46afdd4b24af None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:54.452098 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a46cc-0de9-4df1-9192-46afdd4b24af None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:54.454671 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 160/338] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:54.462285 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f4fd7-fd37-45ee-99c7-a9758444f6c9 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:54.462927 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f4fd7-fd37-45ee-99c7-a9758444f6c9 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:54.463891 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187f4fd7-fd37-45ee-99c7-a9758444f6c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:54.487160 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:54.515981 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-187f4fd7-fd37-45ee-99c7-a9758444f6c9 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:54.518045 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-187f4fd7-fd37-45ee-99c7-a9758444f6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:54.551538 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adf9d0-249b-4366-9c8c-ee568b549f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:54.552910 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adf9d0-249b-4366-9c8c-ee568b549f20 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:54.555107 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adf9d0-249b-4366-9c8c-ee568b549f20 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:54.555914 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adf9d0-249b-4366-9c8c-ee568b549f20 None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:54.556982 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14adf9d0-249b-4366-9c8c-ee568b549f20 None admin] RBAC: Adding query filter params (name=reader) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:54.557696 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14adf9d0-249b-4366-9c8c-ee568b549f20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:54.561703 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14adf9d0-249b-4366-9c8c-ee568b549f20 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:54.585941 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 179/339] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:54.588581 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0d194-2a54-4899-a75e-8a50706f6596 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:54.589332 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0d194-2a54-4899-a75e-8a50706f6596 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:54.589985 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce0d194-2a54-4899-a75e-8a50706f6596 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:54.591716 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 180/340] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:54.593959 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0d194-2a54-4899-a75e-8a50706f6596 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:54.691613 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 161/341] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:38:54.699600 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a3345-a00a-41a2-8221-50f6abdea1a1 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:54.703490 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a3345-a00a-41a2-8221-50f6abdea1a1 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:54.704044 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a3345-a00a-41a2-8221-50f6abdea1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:54.749692 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-4a0a3345-a00a-41a2-8221-50f6abdea1a1 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:54.756739 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-4a0a3345-a00a-41a2-8221-50f6abdea1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:54.868091 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce0d194-2a54-4899-a75e-8a50706f6596 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:54.951416 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506dc1c-ff60-4cf1-a347-809d41b2e3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:54.952357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506dc1c-ff60-4cf1-a347-809d41b2e3ea None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:54.953164 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506dc1c-ff60-4cf1-a347-809d41b2e3ea None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:54.953445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5506dc1c-ff60-4cf1-a347-809d41b2e3ea None admin] PATH_INFO: `/v3/users/b62134dbb1fd4abb80bc6cd18c442ee2` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:54.957072 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 162/342] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:54.960408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506dc1c-ff60-4cf1-a347-809d41b2e3ea None admin] RBAC: Authorizing `identity:get_user(user_id=b62134dbb1fd4abb80bc6cd18c442ee2)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:54.960408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5506dc1c-ff60-4cf1-a347-809d41b2e3ea None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:54.960931 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 181/343] 10.222.0.62 () {56 vars in 1177 bytes} [Wed May 25 15:38:54 2022] GET /identity/v3/users/b62134dbb1fd4abb80bc6cd18c442ee2 => generated 293 bytes in 368 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:54.961875 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a3345-a00a-41a2-8221-50f6abdea1a1 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:54.966498 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506dc1c-ff60-4cf1-a347-809d41b2e3ea None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:54.984130 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:55.114287 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:55.140373 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a3345-a00a-41a2-8221-50f6abdea1a1 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:55.184547 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af0b05-4b38-49ab-a7d7-55e987688af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:55.185589 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af0b05-4b38-49ab-a7d7-55e987688af0 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:55.187498 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af0b05-4b38-49ab-a7d7-55e987688af0 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:55.187801 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2af0b05-4b38-49ab-a7d7-55e987688af0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:55.207788 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2af0b05-4b38-49ab-a7d7-55e987688af0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:55.219518 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-b2af0b05-4b38-49ab-a7d7-55e987688af0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:55.219518 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:55.219518 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:55.219518 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:55.219518 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:55.219518 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:55.219518 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:55.219518 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:55.219518 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:55.219518 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:55.219518 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:55.219518 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:55.219518 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:55.219518 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:55.219518 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:55.219518 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:55.220495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:55.220495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:55.220495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:55.220495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:55.220495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:55.220495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:55.220495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:55.220495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:55.220495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:55.220495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:55.220495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:55.220495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:38:55.220495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:55.220495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:55.220495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:55.220495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:55.221296 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:55.221296 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:55.221296 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:55.221296 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:55.221296 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:55.221296 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:55.221296 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:55.221296 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:55.221296 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:55.221296 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:55.221296 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:55.221296 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:38:55.222448 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 163/344] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:55.222448 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af0b05-4b38-49ab-a7d7-55e987688af0 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:55.252129 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5506dc1c-ff60-4cf1-a347-809d41b2e3ea None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:55.316108 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa8bfe-c9fb-40e6-b651-86e4ac40acde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:55.316809 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa8bfe-c9fb-40e6-b651-86e4ac40acde None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:55.317091 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa8bfe-c9fb-40e6-b651-86e4ac40acde None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:55.317365 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87aa8bfe-c9fb-40e6-b651-86e4ac40acde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:55.318195 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa8bfe-c9fb-40e6-b651-86e4ac40acde None admin] RBAC: Adding query filter params (role.id=29ddb77b56f449aa87fa909f2eebe434, user.id=b62134dbb1fd4abb80bc6cd18c442ee2, scope.system=all) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:55.318501 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa8bfe-c9fb-40e6-b651-86e4ac40acde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:55.320055 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87aa8bfe-c9fb-40e6-b651-86e4ac40acde None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:55.326572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:55.343091 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 182/345] 10.222.0.62 () {56 vars in 1308 bytes} [Wed May 25 15:38:54 2022] GET /identity/v3/role_assignments?user.id=b62134dbb1fd4abb80bc6cd18c442ee2&scope.system=all&role.id=29ddb77b56f449aa87fa909f2eebe434 => generated 510 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:55.344046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa8bfe-c9fb-40e6-b651-86e4ac40acde None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:55.362372 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2af0b05-4b38-49ab-a7d7-55e987688af0 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:55.425725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98399e2f-fa93-4bdb-837e-c3b1e934e48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:55.425725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98399e2f-fa93-4bdb-837e-c3b1e934e48b None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:55.426234 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98399e2f-fa93-4bdb-837e-c3b1e934e48b None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:55.426234 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98399e2f-fa93-4bdb-837e-c3b1e934e48b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:55.445469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98399e2f-fa93-4bdb-837e-c3b1e934e48b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:55.459055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-98399e2f-fa93-4bdb-837e-c3b1e934e48b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:38:55.459055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:55.459055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:55.459055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:55.459055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:55.459055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:55.459055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:55.459055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:55.459055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:55.459055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:55.459055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:55.459055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:55.459055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:55.459055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:55.459055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:55.459055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:55.461598 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:55.461598 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:55.461598 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:55.461598 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:55.461598 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:55.461598 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:55.461598 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:55.461598 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:55.461598 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:55.461598 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:55.461598 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:55.461598 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:38:55.461598 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:55.461598 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:55.461598 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:55.461598 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:55.463613 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:55.463613 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:55.463613 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:55.463613 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:55.463613 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:55.463613 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:55.463613 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:55.463613 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:55.463613 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:55.463613 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:55.463613 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:38:55.463613 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:38:55.463613 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 164/346] 10.222.0.62 () {56 vars in 1114 bytes} [Wed May 25 15:38:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:55.469739 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98399e2f-fa93-4bdb-837e-c3b1e934e48b None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:55.501235 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87aa8bfe-c9fb-40e6-b651-86e4ac40acde None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:55.504140 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:55.578722 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4db78e-6cda-4897-866c-4dbe2be1c841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:55.579415 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4db78e-6cda-4897-866c-4dbe2be1c841 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:55.579705 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4db78e-6cda-4897-866c-4dbe2be1c841 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:55.579980 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4db78e-6cda-4897-866c-4dbe2be1c841 None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:55.580798 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4db78e-6cda-4897-866c-4dbe2be1c841 None admin] RBAC: Adding query filter params (name=member) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:55.581101 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4db78e-6cda-4897-866c-4dbe2be1c841 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:55.582655 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4db78e-6cda-4897-866c-4dbe2be1c841 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:55.609729 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 183/347] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:55.610833 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c796d-4c83-4904-9202-dd60424850ba None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:55.611110 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c796d-4c83-4904-9202-dd60424850ba None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:55.611384 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6c796d-4c83-4904-9202-dd60424850ba None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:55.613055 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 184/348] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:55.626587 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa771b2a-ba25-445f-9f06-c5cc5bdf7f2e None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:55.626587 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa771b2a-ba25-445f-9f06-c5cc5bdf7f2e None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:55.626587 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa771b2a-ba25-445f-9f06-c5cc5bdf7f2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:55.649723 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98399e2f-fa93-4bdb-837e-c3b1e934e48b None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:55.660312 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-aa771b2a-ba25-445f-9f06-c5cc5bdf7f2e None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:55.661580 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-aa771b2a-ba25-445f-9f06-c5cc5bdf7f2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:55.698229 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ef145-f685-4203-9f4d-f8b5859ca09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:55.703034 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ef145-f685-4203-9f4d-f8b5859ca09d None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:55.703797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ef145-f685-4203-9f4d-f8b5859ca09d None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:55.704287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21ef145-f685-4203-9f4d-f8b5859ca09d None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:55.705335 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ef145-f685-4203-9f4d-f8b5859ca09d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:55.706073 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ef145-f685-4203-9f4d-f8b5859ca09d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:55.707779 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21ef145-f685-4203-9f4d-f8b5859ca09d None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:55.714849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:55.720003 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 165/349] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:38:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:55.725328 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ef145-f685-4203-9f4d-f8b5859ca09d None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:55.812740 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 185/350] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:55.813974 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa771b2a-ba25-445f-9f06-c5cc5bdf7f2e None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:55.873403 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21ef145-f685-4203-9f4d-f8b5859ca09d None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:55.927027 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf48bd2-4241-4ae3-84ac-92384e696a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:55.927710 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf48bd2-4241-4ae3-84ac-92384e696a35 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:55.927998 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf48bd2-4241-4ae3-84ac-92384e696a35 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:55.928276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf48bd2-4241-4ae3-84ac-92384e696a35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:55.966113 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:55.975917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa771b2a-ba25-445f-9f06-c5cc5bdf7f2e None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:56.020155 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:56.027662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf48bd2-4241-4ae3-84ac-92384e696a35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:56.028957 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db12e9-15d6-4e53-831d-5700d1ef84c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:56.029529 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf48bd2-4241-4ae3-84ac-92384e696a35 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:56.030034 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db12e9-15d6-4e53-831d-5700d1ef84c6 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:56.030520 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db12e9-15d6-4e53-831d-5700d1ef84c6 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:56.030944 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db12e9-15d6-4e53-831d-5700d1ef84c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:56.148775 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db12e9-15d6-4e53-831d-5700d1ef84c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:56.151227 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db12e9-15d6-4e53-831d-5700d1ef84c6 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:56.159132 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 166/351] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:56.165673 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a4bc5-42d8-43e2-a0e4-fcb4c0c4e2ac None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:56.165673 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a4bc5-42d8-43e2-a0e4-fcb4c0c4e2ac None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:56.165673 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502a4bc5-42d8-43e2-a0e4-fcb4c0c4e2ac None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:56.166916 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 167/352] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:56.167742 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a4bc5-42d8-43e2-a0e4-fcb4c0c4e2ac None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:56.291482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:56.300315 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:56.303132 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502a4bc5-42d8-43e2-a0e4-fcb4c0c4e2ac None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:56.308147 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 186/353] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:56.308906 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db12e9-15d6-4e53-831d-5700d1ef84c6 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:56.351971 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e962a5e-1480-4055-a50e-ff96dd349729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:56.352826 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e962a5e-1480-4055-a50e-ff96dd349729 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:56.353096 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e962a5e-1480-4055-a50e-ff96dd349729 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:56.353369 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e962a5e-1480-4055-a50e-ff96dd349729 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:56.365742 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e962a5e-1480-4055-a50e-ff96dd349729 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:56.374033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-8e962a5e-1480-4055-a50e-ff96dd349729 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:56.374033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:56.374033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:56.374033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:56.374033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:56.374033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:56.374033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:56.374033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:56.374033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:56.374033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:56.374033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:56.374033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:56.374033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:56.374033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:56.374033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:56.374033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:56.378678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:56.378678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:56.378678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:56.378678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:56.378678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:56.378678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:56.378678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:56.378678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:56.378678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:56.378678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:56.378678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:56.378678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:38:56.378678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:56.378678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:56.378678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:56.378678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:56.379502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:56.379502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:56.379502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:56.379502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:56.379502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:56.379502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:56.379502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:56.379502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:56.379502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:56.379502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:56.379502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:38:56.379502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:38:56.379502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 168/354] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:56.379502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f954ce4-e9d7-4a28-833a-996a2fc1271f None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:56.380216 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f954ce4-e9d7-4a28-833a-996a2fc1271f None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:56.380216 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f954ce4-e9d7-4a28-833a-996a2fc1271f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:56.398225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-2f954ce4-e9d7-4a28-833a-996a2fc1271f None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:56.398225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-2f954ce4-e9d7-4a28-833a-996a2fc1271f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:56.450108 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db12e9-15d6-4e53-831d-5700d1ef84c6 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:56.488517 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 169/355] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:56.488517 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f954ce4-e9d7-4a28-833a-996a2fc1271f None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:56.492568 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2e4c6-be19-45b6-83a3-d6e3680759e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:56.492568 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2e4c6-be19-45b6-83a3-d6e3680759e1 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:56.492568 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2e4c6-be19-45b6-83a3-d6e3680759e1 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:56.492568 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2e4c6-be19-45b6-83a3-d6e3680759e1 None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:56.494294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2e4c6-be19-45b6-83a3-d6e3680759e1 None admin] RBAC: Authorizing `identity:get_project(project_id=6daed429aa5449e2923488e535a6a243)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:56.495850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2e4c6-be19-45b6-83a3-d6e3680759e1 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:56.497894 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 187/356] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:56 2022] GET /identity/v3/projects/6daed429aa5449e2923488e535a6a243 => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:56.498599 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2e4c6-be19-45b6-83a3-d6e3680759e1 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:56.573398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:56.592074 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:56.612810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f954ce4-e9d7-4a28-833a-996a2fc1271f None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:56.623664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2e4c6-be19-45b6-83a3-d6e3680759e1 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:56.653735 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48edd8f-8576-421e-a06a-1640d6ae74ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:56.654603 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48edd8f-8576-421e-a06a-1640d6ae74ab None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:56.654890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48edd8f-8576-421e-a06a-1640d6ae74ab None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:56.655169 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48edd8f-8576-421e-a06a-1640d6ae74ab None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:56.657148 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48edd8f-8576-421e-a06a-1640d6ae74ab None admin] RBAC: Authorizing `identity:get_project(project_id=6daed429aa5449e2923488e535a6a243)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:56.658611 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48edd8f-8576-421e-a06a-1640d6ae74ab None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:56.665482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 170/357] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:56 2022] GET /identity/v3/projects/6daed429aa5449e2923488e535a6a243 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:56.665482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372bd1d-c9a3-4ea4-8ba9-6b73bdce7243 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:56.665482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372bd1d-c9a3-4ea4-8ba9-6b73bdce7243 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:56.665482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1372bd1d-c9a3-4ea4-8ba9-6b73bdce7243 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:56.665482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 171/358] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:56.665482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372bd1d-c9a3-4ea4-8ba9-6b73bdce7243 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:56.668049 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48514f-b9c2-42b7-9691-5c86a5025df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:56.668049 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48514f-b9c2-42b7-9691-5c86a5025df4 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:56.668049 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48514f-b9c2-42b7-9691-5c86a5025df4 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:56.668498 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48514f-b9c2-42b7-9691-5c86a5025df4 None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:56.669255 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48514f-b9c2-42b7-9691-5c86a5025df4 None admin] RBAC: Adding query filter params (name=member) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:56.669570 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48514f-b9c2-42b7-9691-5c86a5025df4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:56.671810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48514f-b9c2-42b7-9691-5c86a5025df4 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:56.681064 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 188/359] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:38:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:56.681763 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48514f-b9c2-42b7-9691-5c86a5025df4 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:56.808092 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48514f-b9c2-42b7-9691-5c86a5025df4 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:56.808521 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1372bd1d-c9a3-4ea4-8ba9-6b73bdce7243 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:56.841857 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:56.855954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b42f5-2e77-4ee9-8003-73d1ab79887f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:56.856319 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea6436-7fe5-4e95-b827-961d571a3f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:56.857737 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b42f5-2e77-4ee9-8003-73d1ab79887f None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:56.857737 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b42f5-2e77-4ee9-8003-73d1ab79887f None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:56.857944 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea6436-7fe5-4e95-b827-961d571a3f02 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:56.858013 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b42f5-2e77-4ee9-8003-73d1ab79887f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:56.858079 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea6436-7fe5-4e95-b827-961d571a3f02 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:56.858079 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcea6436-7fe5-4e95-b827-961d571a3f02 None admin] PATH_INFO: `/v3/groups/afdb1abcfd08447faf323424769702e5` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:56.866004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea6436-7fe5-4e95-b827-961d571a3f02 None admin] RBAC: Authorizing `identity:get_group(group_id=afdb1abcfd08447faf323424769702e5)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:56.868130 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcea6436-7fe5-4e95-b827-961d571a3f02 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:56.870060 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 172/360] 10.222.0.62 () {56 vars in 1180 bytes} [Wed May 25 15:38:56 2022] GET /identity/v3/groups/afdb1abcfd08447faf323424769702e5 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:56.870845 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea6436-7fe5-4e95-b827-961d571a3f02 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:56.873846 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63b42f5-2e77-4ee9-8003-73d1ab79887f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:56.883605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-c63b42f5-2e77-4ee9-8003-73d1ab79887f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:38:56.883605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:56.883605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:56.883605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:56.883605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:56.883605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:56.883605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:56.883605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:56.883605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:56.883605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:56.883605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:56.883605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:56.883605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:56.883605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:56.883605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:56.883605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:56.884634 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:56.884634 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:56.884634 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:56.884634 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:56.884634 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:56.884634 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:56.884634 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:56.884634 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:56.884634 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:56.884634 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:56.884634 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:56.884634 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:56.884634 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:56.884634 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:56.884634 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:56.884634 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:56.885491 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:56.885491 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:56.885491 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:56.885491 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:56.885491 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:56.885491 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:56.885491 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:56.885491 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:56.885491 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:56.885491 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:56.885491 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:38:56.885491 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:56.890995 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 189/361] 10.222.0.62 () {56 vars in 1114 bytes} [Wed May 25 15:38:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:56.892469 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098528e9-c1af-42bb-8bed-58ade38b57f8 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:56.892765 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098528e9-c1af-42bb-8bed-58ade38b57f8 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:56.893901 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098528e9-c1af-42bb-8bed-58ade38b57f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:56.896666 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:56.912688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-098528e9-c1af-42bb-8bed-58ade38b57f8 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:56.914019 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-098528e9-c1af-42bb-8bed-58ade38b57f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:38:56.996160 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 190/362] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:38:56.997126 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098528e9-c1af-42bb-8bed-58ade38b57f8 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:57.009199 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcea6436-7fe5-4e95-b827-961d571a3f02 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:57.060478 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe5d9a-39ff-4178-a8c2-64018cdbd07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:57.062383 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe5d9a-39ff-4178-a8c2-64018cdbd07e None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:57.062827 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe5d9a-39ff-4178-a8c2-64018cdbd07e None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:57.064332 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfe5d9a-39ff-4178-a8c2-64018cdbd07e None admin] PATH_INFO: `/v3/groups/afdb1abcfd08447faf323424769702e5` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:57.066951 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe5d9a-39ff-4178-a8c2-64018cdbd07e None admin] RBAC: Authorizing `identity:get_group(group_id=afdb1abcfd08447faf323424769702e5)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:57.069661 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dfe5d9a-39ff-4178-a8c2-64018cdbd07e None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:57.072537 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 173/363] 10.222.0.62 () {56 vars in 1180 bytes} [Wed May 25 15:38:56 2022] GET /identity/v3/groups/afdb1abcfd08447faf323424769702e5 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:57.073817 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe5d9a-39ff-4178-a8c2-64018cdbd07e None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:57.156129 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098528e9-c1af-42bb-8bed-58ade38b57f8 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:57.182988 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:57.204587 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5063060-9fa2-4fd9-977d-3ef77ec8edab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:57.206097 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5063060-9fa2-4fd9-977d-3ef77ec8edab None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:57.206598 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5063060-9fa2-4fd9-977d-3ef77ec8edab None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:57.207086 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5063060-9fa2-4fd9-977d-3ef77ec8edab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:57.216903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:57.235646 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfe5d9a-39ff-4178-a8c2-64018cdbd07e None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:57.289506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555531b-3113-4411-9a0d-a6f82b4116c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:57.290176 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555531b-3113-4411-9a0d-a6f82b4116c4 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:57.290460 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555531b-3113-4411-9a0d-a6f82b4116c4 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:57.290741 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a555531b-3113-4411-9a0d-a6f82b4116c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:57.291580 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555531b-3113-4411-9a0d-a6f82b4116c4 None admin] RBAC: Adding query filter params (group.id=afdb1abcfd08447faf323424769702e5, role.id=5614294f6ab949a99424ee6e983b6430, scope.project.id=6daed429aa5449e2923488e535a6a243) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:57.291896 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555531b-3113-4411-9a0d-a6f82b4116c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:57.293432 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a555531b-3113-4411-9a0d-a6f82b4116c4 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:57.300330 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 174/364] 10.222.0.62 () {56 vars in 1376 bytes} [Wed May 25 15:38:57 2022] GET /identity/v3/role_assignments?group.id=afdb1abcfd08447faf323424769702e5&scope.project.id=6daed429aa5449e2923488e535a6a243&role.id=5614294f6ab949a99424ee6e983b6430 => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:57.301224 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555531b-3113-4411-9a0d-a6f82b4116c4 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:57.304358 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5063060-9fa2-4fd9-977d-3ef77ec8edab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:57.306306 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5063060-9fa2-4fd9-977d-3ef77ec8edab None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:57.470772 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 191/365] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:57.471586 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5063060-9fa2-4fd9-977d-3ef77ec8edab None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:57.493344 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a555531b-3113-4411-9a0d-a6f82b4116c4 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:57.517160 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:57.557677 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e69ae-b17d-4ad8-b962-e202664f1ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:57.558380 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e69ae-b17d-4ad8-b962-e202664f1ffa None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:57.558816 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e69ae-b17d-4ad8-b962-e202664f1ffa None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:57.559102 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e69ae-b17d-4ad8-b962-e202664f1ffa None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:57.559866 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e69ae-b17d-4ad8-b962-e202664f1ffa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:57.560179 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e69ae-b17d-4ad8-b962-e202664f1ffa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:57.562467 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e69ae-b17d-4ad8-b962-e202664f1ffa None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:57.579727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 175/366] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:38:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:57.579727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e69ae-b17d-4ad8-b962-e202664f1ffa None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:57.597444 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:57.619077 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5063060-9fa2-4fd9-977d-3ef77ec8edab None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:57.672177 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316b1f7-1e47-42e8-8a09-e14f4ceac57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:57.673137 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316b1f7-1e47-42e8-8a09-e14f4ceac57c None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:57.673482 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316b1f7-1e47-42e8-8a09-e14f4ceac57c None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:57.673823 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0316b1f7-1e47-42e8-8a09-e14f4ceac57c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:57.691155 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0316b1f7-1e47-42e8-8a09-e14f4ceac57c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:38:57.699888 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-0316b1f7-1e47-42e8-8a09-e14f4ceac57c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:38:57.699888 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:38:57.699888 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:38:57.699888 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:38:57.699888 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:38:57.699888 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:38:57.699888 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:38:57.699888 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:38:57.699888 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:38:57.699888 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:38:57.699888 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:38:57.699888 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:38:57.699888 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:38:57.699888 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:38:57.699888 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:38:57.699888 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:38:57.701075 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:38:57.701075 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:38:57.701075 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:38:57.701075 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:38:57.701075 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:38:57.701075 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:38:57.701075 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:38:57.701075 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:38:57.701075 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:38:57.701075 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:38:57.701075 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:38:57.701075 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:38:57.701075 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:38:57.701075 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:38:57.701075 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:38:57.701075 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:38:57.701977 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:38:57.701977 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:38:57.701977 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:38:57.701977 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:38:57.701977 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:38:57.701977 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:38:57.701977 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:38:57.701977 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:38:57.701977 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:38:57.701977 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:38:57.701977 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:38:57.701977 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:38:57.704673 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 192/367] 10.222.0.62 () {56 vars in 1096 bytes} [Wed May 25 15:38:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:38:57.704673 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316b1f7-1e47-42e8-8a09-e14f4ceac57c None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:57.723580 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e69ae-b17d-4ad8-b962-e202664f1ffa None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:57.781651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea038e3-8bc7-44fb-87bf-2938647df31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:57.782395 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea038e3-8bc7-44fb-87bf-2938647df31f None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:57.782914 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea038e3-8bc7-44fb-87bf-2938647df31f None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:57.782914 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea038e3-8bc7-44fb-87bf-2938647df31f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:57.785043 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea038e3-8bc7-44fb-87bf-2938647df31f None admin] RBAC: Adding query filter params (group.id=afdb1abcfd08447faf323424769702e5, role.id=abd8e1d1d7cd45cc93ed82f651c74d9b, scope.project.id=6daed429aa5449e2923488e535a6a243) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:57.785043 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea038e3-8bc7-44fb-87bf-2938647df31f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:57.785741 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea038e3-8bc7-44fb-87bf-2938647df31f None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:57.793174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 176/368] 10.222.0.62 () {56 vars in 1376 bytes} [Wed May 25 15:38:57 2022] GET /identity/v3/role_assignments?group.id=afdb1abcfd08447faf323424769702e5&scope.project.id=6daed429aa5449e2923488e535a6a243&role.id=abd8e1d1d7cd45cc93ed82f651c74d9b => generated 260 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:57.795765 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea038e3-8bc7-44fb-87bf-2938647df31f None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:57.863846 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:57.869229 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0316b1f7-1e47-42e8-8a09-e14f4ceac57c None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:57.920530 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:57.923820 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab3021-b6a3-4d5b-931b-81e92b81ab7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:57.924916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab3021-b6a3-4d5b-931b-81e92b81ab7c None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:57.925407 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab3021-b6a3-4d5b-931b-81e92b81ab7c None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:57.925714 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ab3021-b6a3-4d5b-931b-81e92b81ab7c None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:57.927138 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab3021-b6a3-4d5b-931b-81e92b81ab7c None admin] RBAC: Authorizing `identity:get_project(project_id=8c22dbab894644ce84024119b5b8a26c)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:57.928839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ab3021-b6a3-4d5b-931b-81e92b81ab7c None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:57.930944 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 193/369] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:57 2022] GET /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:57.931671 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab3021-b6a3-4d5b-931b-81e92b81ab7c None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:57.947965 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea038e3-8bc7-44fb-87bf-2938647df31f None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:57.989251 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3037f7c-b1f5-49ed-a2f0-af0afb206fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:57.989895 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3037f7c-b1f5-49ed-a2f0-af0afb206fdf None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:57.990191 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3037f7c-b1f5-49ed-a2f0-af0afb206fdf None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:57.990478 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3037f7c-b1f5-49ed-a2f0-af0afb206fdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:58.059206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ab3021-b6a3-4d5b-931b-81e92b81ab7c None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:58.077592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3037f7c-b1f5-49ed-a2f0-af0afb206fdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:58.079090 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3037f7c-b1f5-49ed-a2f0-af0afb206fdf None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:58.104452 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82012680-84a1-4d88-acd8-a18379b42537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:58.105194 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82012680-84a1-4d88-acd8-a18379b42537 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:58.105481 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82012680-84a1-4d88-acd8-a18379b42537 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:58.105759 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82012680-84a1-4d88-acd8-a18379b42537 None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:58.106967 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82012680-84a1-4d88-acd8-a18379b42537 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:58.107278 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82012680-84a1-4d88-acd8-a18379b42537 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:58.109304 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82012680-84a1-4d88-acd8-a18379b42537 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:58.121756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 194/370] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:38:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:58.122709 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82012680-84a1-4d88-acd8-a18379b42537 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:58.133554 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:58.175625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:58.201852 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 177/371] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:58.203319 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3037f7c-b1f5-49ed-a2f0-af0afb206fdf None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:58.239402 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82012680-84a1-4d88-acd8-a18379b42537 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:58.277524 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afd934-f3ab-415d-b350-2caa9009736c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:58.278766 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afd934-f3ab-415d-b350-2caa9009736c None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:58.279195 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afd934-f3ab-415d-b350-2caa9009736c None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:58.279634 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93afd934-f3ab-415d-b350-2caa9009736c None admin] PATH_INFO: `/v3/groups/afdb1abcfd08447faf323424769702e5` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:58.281986 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afd934-f3ab-415d-b350-2caa9009736c None admin] RBAC: Authorizing `identity:get_group(group_id=afdb1abcfd08447faf323424769702e5)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:58.283460 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93afd934-f3ab-415d-b350-2caa9009736c None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:58.285511 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 195/372] 10.222.0.62 () {56 vars in 1180 bytes} [Wed May 25 15:38:58 2022] GET /identity/v3/groups/afdb1abcfd08447faf323424769702e5 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:58.286360 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afd934-f3ab-415d-b350-2caa9009736c None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:58.322906 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3037f7c-b1f5-49ed-a2f0-af0afb206fdf None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:58.362218 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40362686-26d1-4183-9099-31151095bda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:58.362879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40362686-26d1-4183-9099-31151095bda6 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:58.363210 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40362686-26d1-4183-9099-31151095bda6 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:58.363507 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40362686-26d1-4183-9099-31151095bda6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:58.371246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:58.401114 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93afd934-f3ab-415d-b350-2caa9009736c None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:58.416986 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:58.438816 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb24c1-f8b4-420f-93fe-3de6768daf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:58.439718 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb24c1-f8b4-420f-93fe-3de6768daf03 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:58.440002 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb24c1-f8b4-420f-93fe-3de6768daf03 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:58.440279 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb24c1-f8b4-420f-93fe-3de6768daf03 None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:58.441547 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb24c1-f8b4-420f-93fe-3de6768daf03 None admin] RBAC: Authorizing `identity:get_project(project_id=8c22dbab894644ce84024119b5b8a26c)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:58.443079 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb24c1-f8b4-420f-93fe-3de6768daf03 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:58.443794 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40362686-26d1-4183-9099-31151095bda6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:58.445138 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 196/373] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:58 2022] GET /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:58.445654 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40362686-26d1-4183-9099-31151095bda6 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:58.445978 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb24c1-f8b4-420f-93fe-3de6768daf03 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:58.555740 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb24c1-f8b4-420f-93fe-3de6768daf03 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:58.558127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 178/374] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:38:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:38:58.559215 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40362686-26d1-4183-9099-31151095bda6 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:58.595948 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8464a-7f3f-454c-846d-6ba90b18a2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:58.596653 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8464a-7f3f-454c-846d-6ba90b18a2b6 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:58.596936 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8464a-7f3f-454c-846d-6ba90b18a2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:58.597471 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d8464a-7f3f-454c-846d-6ba90b18a2b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:58.598045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8464a-7f3f-454c-846d-6ba90b18a2b6 None admin] RBAC: Adding query filter params (group.id=afdb1abcfd08447faf323424769702e5, role.id=5614294f6ab949a99424ee6e983b6430, scope.project.id=8c22dbab894644ce84024119b5b8a26c) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:58.598356 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8464a-7f3f-454c-846d-6ba90b18a2b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:58.599800 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d8464a-7f3f-454c-846d-6ba90b18a2b6 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:58.606475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 197/375] 10.222.0.62 () {56 vars in 1376 bytes} [Wed May 25 15:38:58 2022] GET /identity/v3/role_assignments?group.id=afdb1abcfd08447faf323424769702e5&scope.project.id=8c22dbab894644ce84024119b5b8a26c&role.id=5614294f6ab949a99424ee6e983b6430 => generated 260 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:58.607385 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8464a-7f3f-454c-846d-6ba90b18a2b6 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:58.621067 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:58.652950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:58.680352 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40362686-26d1-4183-9099-31151095bda6 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:58.718752 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d8464a-7f3f-454c-846d-6ba90b18a2b6 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:58.720807 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8fd5f-5c89-4a35-b0c2-6d51ee11ad9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:58.721935 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8fd5f-5c89-4a35-b0c2-6d51ee11ad9f None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:58.722472 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8fd5f-5c89-4a35-b0c2-6d51ee11ad9f None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:58.722954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc8fd5f-5c89-4a35-b0c2-6d51ee11ad9f None admin] PATH_INFO: `/v3/groups/afdb1abcfd08447faf323424769702e5` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:58.724546 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8fd5f-5c89-4a35-b0c2-6d51ee11ad9f None admin] RBAC: Authorizing `identity:get_group(group_id=afdb1abcfd08447faf323424769702e5)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:58.726284 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc8fd5f-5c89-4a35-b0c2-6d51ee11ad9f None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:58.732862 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 179/376] 10.222.0.62 () {56 vars in 1180 bytes} [Wed May 25 15:38:58 2022] GET /identity/v3/groups/afdb1abcfd08447faf323424769702e5 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:58.735764 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8fd5f-5c89-4a35-b0c2-6d51ee11ad9f None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:58.758063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b5c47-2367-4ac9-8860-f4d0044c0485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:58.758940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b5c47-2367-4ac9-8860-f4d0044c0485 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:58.759225 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b5c47-2367-4ac9-8860-f4d0044c0485 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:58.759502 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93b5c47-2367-4ac9-8860-f4d0044c0485 None admin] PATH_INFO: `/v3/projects/7b5e6c2944d540b0b18682f21c8da32d` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:58.760966 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b5c47-2367-4ac9-8860-f4d0044c0485 None admin] RBAC: Authorizing `identity:get_project(project_id=7b5e6c2944d540b0b18682f21c8da32d)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:58.762403 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93b5c47-2367-4ac9-8860-f4d0044c0485 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:58.764786 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 198/377] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:38:58 2022] GET /identity/v3/projects/7b5e6c2944d540b0b18682f21c8da32d => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:58.773874 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b5c47-2367-4ac9-8860-f4d0044c0485 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:58.863135 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc8fd5f-5c89-4a35-b0c2-6d51ee11ad9f None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:58.906606 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d72152-15f8-41e1-9f6a-4bc2c82f8705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:58.907272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d72152-15f8-41e1-9f6a-4bc2c82f8705 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:58.907567 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d72152-15f8-41e1-9f6a-4bc2c82f8705 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:58.907847 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d72152-15f8-41e1-9f6a-4bc2c82f8705 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:58.908712 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d72152-15f8-41e1-9f6a-4bc2c82f8705 None admin] RBAC: Adding query filter params (group.id=afdb1abcfd08447faf323424769702e5, role.id=abd8e1d1d7cd45cc93ed82f651c74d9b, scope.project.id=8c22dbab894644ce84024119b5b8a26c) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:58.911353 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d72152-15f8-41e1-9f6a-4bc2c82f8705 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:58.911353 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d72152-15f8-41e1-9f6a-4bc2c82f8705 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:58.916390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 180/378] 10.222.0.62 () {56 vars in 1376 bytes} [Wed May 25 15:38:58 2022] GET /identity/v3/role_assignments?group.id=afdb1abcfd08447faf323424769702e5&scope.project.id=8c22dbab894644ce84024119b5b8a26c&role.id=abd8e1d1d7cd45cc93ed82f651c74d9b => generated 260 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:38:58.975825 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:59.023617 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93b5c47-2367-4ac9-8860-f4d0044c0485 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:59.076114 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0334999a-e59e-4b2c-83a6-34e323d856a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:59.078473 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334999a-e59e-4b2c-83a6-34e323d856a8 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:59.079017 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334999a-e59e-4b2c-83a6-34e323d856a8 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:59.079574 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0334999a-e59e-4b2c-83a6-34e323d856a8 None admin] PATH_INFO: `/v3/groups/758c172fe7d0496586e1b13ce929233b` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:59.092659 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334999a-e59e-4b2c-83a6-34e323d856a8 None admin] RBAC: Authorizing `identity:get_group(group_id=758c172fe7d0496586e1b13ce929233b)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:59.094754 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0334999a-e59e-4b2c-83a6-34e323d856a8 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:59.096915 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 199/379] 10.222.0.62 () {56 vars in 1180 bytes} [Wed May 25 15:38:58 2022] GET /identity/v3/groups/758c172fe7d0496586e1b13ce929233b => generated 229 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:59.103114 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d72152-15f8-41e1-9f6a-4bc2c82f8705 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:38:59.123030 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:38:59.260404 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d72152-15f8-41e1-9f6a-4bc2c82f8705 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:38:59.305667 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f91f19b-3251-4412-ad58-792ae1c6be90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:38:59.306724 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91f19b-3251-4412-ad58-792ae1c6be90 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:59.307202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91f19b-3251-4412-ad58-792ae1c6be90 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:59.307729 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f91f19b-3251-4412-ad58-792ae1c6be90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:59.308776 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91f19b-3251-4412-ad58-792ae1c6be90 None admin] RBAC: Adding query filter params (group.id=758c172fe7d0496586e1b13ce929233b, role.id=ae72bfdddd1e4a94a21a0d53264ee157, scope.project.id=7b5e6c2944d540b0b18682f21c8da32d) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:38:59.309297 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91f19b-3251-4412-ad58-792ae1c6be90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:38:59.310964 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f91f19b-3251-4412-ad58-792ae1c6be90 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:38:59.325310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 181/380] 10.222.0.62 () {56 vars in 1376 bytes} [Wed May 25 15:38:59 2022] GET /identity/v3/role_assignments?group.id=758c172fe7d0496586e1b13ce929233b&scope.project.id=7b5e6c2944d540b0b18682f21c8da32d&role.id=ae72bfdddd1e4a94a21a0d53264ee157 => generated 260 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:38:59.935036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437c2d6-fef6-4434-8426-ac8fc2c8b4ae None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:59.935409 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437c2d6-fef6-4434-8426-ac8fc2c8b4ae None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:59.935613 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4437c2d6-fef6-4434-8426-ac8fc2c8b4ae None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:59.937329 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 200/381] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:38:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:38:59.943052 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1b4e5-a34d-4191-bbfe-125620bbe531 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:38:59.943350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1b4e5-a34d-4191-bbfe-125620bbe531 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:38:59.943638 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1b4e5-a34d-4191-bbfe-125620bbe531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:38:59.969688 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-b8b1b4e5-a34d-4191-bbfe-125620bbe531 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:38:59.970944 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-b8b1b4e5-a34d-4191-bbfe-125620bbe531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:00.066728 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 182/382] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:38:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:39:00.095846 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437c2d6-fef6-4434-8426-ac8fc2c8b4ae None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:00.245783 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4437c2d6-fef6-4434-8426-ac8fc2c8b4ae None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:00.294581 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af067fbe-9915-499f-9b68-2322dfb7fa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:00.295438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af067fbe-9915-499f-9b68-2322dfb7fa57 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:00.295728 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af067fbe-9915-499f-9b68-2322dfb7fa57 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:00.296356 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af067fbe-9915-499f-9b68-2322dfb7fa57 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:00.310747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:00.320347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af067fbe-9915-499f-9b68-2322dfb7fa57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:00.329640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-af067fbe-9915-499f-9b68-2322dfb7fa57 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:39:00.329640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:00.329640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:00.329640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:00.329640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:00.329640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:00.329640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:00.329640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:00.329640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:00.329640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:00.329640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:00.329640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:00.329640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:00.329640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:00.329640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:00.329640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:00.330572 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:00.330572 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:00.330572 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:00.330572 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:00.330572 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:00.330572 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:00.330572 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:00.330572 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:00.330572 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:00.330572 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:00.330572 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:00.330572 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:00.330572 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:00.330572 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:00.330572 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:00.330572 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:00.331460 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:00.331460 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:00.331460 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:00.331460 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:00.331460 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:00.331460 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:00.331460 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:00.331460 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:00.331460 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:00.331460 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:00.331460 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:39:00.331460 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:00.332072 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 201/383] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:39:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:00.340823 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1b4e5-a34d-4191-bbfe-125620bbe531 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:00.343021 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:00.460932 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1b4e5-a34d-4191-bbfe-125620bbe531 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:00.502816 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c49d5fb-a6f2-47dd-a0b9-dd7f8d503686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:00.503741 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49d5fb-a6f2-47dd-a0b9-dd7f8d503686 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:00.504123 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49d5fb-a6f2-47dd-a0b9-dd7f8d503686 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:00.504532 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c49d5fb-a6f2-47dd-a0b9-dd7f8d503686 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:00.505671 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49d5fb-a6f2-47dd-a0b9-dd7f8d503686 None admin] RBAC: Adding query filter params (name=member) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:00.506097 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49d5fb-a6f2-47dd-a0b9-dd7f8d503686 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:00.507512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c49d5fb-a6f2-47dd-a0b9-dd7f8d503686 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:00.524622 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 183/384] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:39:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:00.527919 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af067fbe-9915-499f-9b68-2322dfb7fa57 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:00.656501 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bbefb-8144-44ae-8d46-6d833a00d32a None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:00.656990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bbefb-8144-44ae-8d46-6d833a00d32a None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:00.657554 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1bbefb-8144-44ae-8d46-6d833a00d32a None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:00.660191 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 184/385] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:00.666193 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d7868-79b5-4377-9134-9cf863fe5160 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:00.666483 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d7868-79b5-4377-9134-9cf863fe5160 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:00.666750 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d7868-79b5-4377-9134-9cf863fe5160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:00.691574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-ca8d7868-79b5-4377-9134-9cf863fe5160 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:00.692855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-ca8d7868-79b5-4377-9134-9cf863fe5160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:00.694951 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af067fbe-9915-499f-9b68-2322dfb7fa57 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:00.737847 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61086af-deda-4325-8ceb-f623cecf536c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:00.738724 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61086af-deda-4325-8ceb-f623cecf536c None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:00.739011 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61086af-deda-4325-8ceb-f623cecf536c None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:00.739287 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61086af-deda-4325-8ceb-f623cecf536c None admin] PATH_INFO: `/v3/groups/afdb1abcfd08447faf323424769702e5` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:00.740631 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61086af-deda-4325-8ceb-f623cecf536c None admin] RBAC: Authorizing `identity:get_group(group_id=afdb1abcfd08447faf323424769702e5)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:00.742239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61086af-deda-4325-8ceb-f623cecf536c None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:00.744304 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 202/386] 10.222.0.62 () {56 vars in 1180 bytes} [Wed May 25 15:39:00 2022] GET /identity/v3/groups/afdb1abcfd08447faf323424769702e5 => generated 226 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:00.754077 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61086af-deda-4325-8ceb-f623cecf536c None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:00.766748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:00.776103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 185/387] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:39:00.806152 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d7868-79b5-4377-9134-9cf863fe5160 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:00.896762 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:00.931604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d7868-79b5-4377-9134-9cf863fe5160 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:00.972034 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b075b-3534-48eb-851f-02be7dee3517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:00.972936 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b075b-3534-48eb-851f-02be7dee3517 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:00.973218 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b075b-3534-48eb-851f-02be7dee3517 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:00.973547 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b075b-3534-48eb-851f-02be7dee3517 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:00.974463 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61086af-deda-4325-8ceb-f623cecf536c None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:00.987481 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99b075b-3534-48eb-851f-02be7dee3517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:00.997540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-b99b075b-3534-48eb-851f-02be7dee3517 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:39:00.997540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:00.997540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:00.997540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:00.997540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:00.997540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:00.997540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:00.997540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:00.997540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:00.997540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:00.997540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:00.997540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:00.997540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:00.997540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:00.997540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:00.997540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:00.998454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:00.998454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:00.998454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:00.998454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:00.998454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:00.998454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:00.998454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:00.998454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:00.998454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:00.998454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:00.998454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:00.998454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:00.998454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:00.998454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:00.998454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:00.998454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:01.000213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:01.000213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:01.000213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:01.000213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:01.000213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:01.000213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:01.000213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:01.000213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:01.000213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:01.000213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:01.000213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:39:01.000213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:01.003472 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 186/388] 10.222.0.62 () {56 vars in 1114 bytes} [Wed May 25 15:39:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:01.006699 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b075b-3534-48eb-851f-02be7dee3517 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:01.065647 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f91ef-461d-4936-90af-f36cc6b20d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:01.066539 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f91ef-461d-4936-90af-f36cc6b20d0c None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:01.066824 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f91ef-461d-4936-90af-f36cc6b20d0c None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:01.067098 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8f91ef-461d-4936-90af-f36cc6b20d0c None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:01.073608 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f91ef-461d-4936-90af-f36cc6b20d0c None admin] RBAC: Authorizing `identity:get_project(project_id=6daed429aa5449e2923488e535a6a243)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:01.074811 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:01.075945 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8f91ef-461d-4936-90af-f36cc6b20d0c None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:01.078215 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 203/389] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:39:00 2022] GET /identity/v3/projects/6daed429aa5449e2923488e535a6a243 => generated 298 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:01.090933 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f91ef-461d-4936-90af-f36cc6b20d0c None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:01.137337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99b075b-3534-48eb-851f-02be7dee3517 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:01.217426 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd492d-f145-4cb3-9a42-0d8581665dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:01.218143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd492d-f145-4cb3-9a42-0d8581665dfa None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:01.218429 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd492d-f145-4cb3-9a42-0d8581665dfa None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:01.218755 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dd492d-f145-4cb3-9a42-0d8581665dfa None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:01.219516 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd492d-f145-4cb3-9a42-0d8581665dfa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:01.219834 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd492d-f145-4cb3-9a42-0d8581665dfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:01.225017 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dd492d-f145-4cb3-9a42-0d8581665dfa None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:01.244709 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 187/390] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:01.256596 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd492d-f145-4cb3-9a42-0d8581665dfa None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:01.334475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8f91ef-461d-4936-90af-f36cc6b20d0c None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:01.417827 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d750495-a2aa-401a-9bab-403316cbacf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:01.418757 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d750495-a2aa-401a-9bab-403316cbacf9 None admin] REQUEST_METHOD: `PUT` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:01.419043 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d750495-a2aa-401a-9bab-403316cbacf9 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:01.419431 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d750495-a2aa-401a-9bab-403316cbacf9 None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243/groups/afdb1abcfd08447faf323424769702e5/roles/5614294f6ab949a99424ee6e983b6430` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:01.422094 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d750495-a2aa-401a-9bab-403316cbacf9 None admin] RBAC: Authorizing `identity:create_grant(project_id=6daed429aa5449e2923488e535a6a243, group_id=afdb1abcfd08447faf323424769702e5, role_id=5614294f6ab949a99424ee6e983b6430)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:01.423606 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d750495-a2aa-401a-9bab-403316cbacf9 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:01.427546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:01.450689 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dd492d-f145-4cb3-9a42-0d8581665dfa None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:01.472395 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:01.492610 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd9519-ae6f-4a2c-9285-340bba5e0c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:01.493481 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd9519-ae6f-4a2c-9285-340bba5e0c3b None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:01.493768 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd9519-ae6f-4a2c-9285-340bba5e0c3b None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:01.494049 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd9519-ae6f-4a2c-9285-340bba5e0c3b None admin] PATH_INFO: `/v3/groups/afdb1abcfd08447faf323424769702e5` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:01.495324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd9519-ae6f-4a2c-9285-340bba5e0c3b None admin] RBAC: Authorizing `identity:get_group(group_id=afdb1abcfd08447faf323424769702e5)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:01.496931 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dd9519-ae6f-4a2c-9285-340bba5e0c3b None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:01.504039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 188/391] 10.222.0.62 () {56 vars in 1180 bytes} [Wed May 25 15:39:01 2022] GET /identity/v3/groups/afdb1abcfd08447faf323424769702e5 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:01.506111 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd9519-ae6f-4a2c-9285-340bba5e0c3b None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:01.572833 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 204/392] 10.222.0.62 () {58 vars in 1442 bytes} [Wed May 25 15:39:01 2022] PUT /identity/v3/projects/6daed429aa5449e2923488e535a6a243/groups/afdb1abcfd08447faf323424769702e5/roles/5614294f6ab949a99424ee6e983b6430 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:39:01.627515 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd9519-ae6f-4a2c-9285-340bba5e0c3b None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:01.664536 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8d7f7-2bba-423e-8723-95636f3026df None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:01.671025 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8d7f7-2bba-423e-8723-95636f3026df None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:01.671025 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac8d7f7-2bba-423e-8723-95636f3026df None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:01.671025 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 205/393] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:01.671486 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4ff35-59f0-4ae6-806e-1b1cbd738945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:01.671486 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4ff35-59f0-4ae6-806e-1b1cbd738945 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:01.671486 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4ff35-59f0-4ae6-806e-1b1cbd738945 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:01.671486 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e4ff35-59f0-4ae6-806e-1b1cbd738945 None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:01.672283 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4ff35-59f0-4ae6-806e-1b1cbd738945 None admin] RBAC: Authorizing `identity:get_project(project_id=6daed429aa5449e2923488e535a6a243)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:01.673930 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e4ff35-59f0-4ae6-806e-1b1cbd738945 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:01.674151 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a2454-1983-459a-88e2-beba3e584c5b None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:01.674314 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a2454-1983-459a-88e2-beba3e584c5b None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:01.674544 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72a2454-1983-459a-88e2-beba3e584c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:01.680606 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 189/394] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:39:01 2022] GET /identity/v3/projects/6daed429aa5449e2923488e535a6a243 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:01.682238 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4ff35-59f0-4ae6-806e-1b1cbd738945 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:01.717251 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-e72a2454-1983-459a-88e2-beba3e584c5b None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:01.719400 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-e72a2454-1983-459a-88e2-beba3e584c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:01.752566 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:01.811161 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e4ff35-59f0-4ae6-806e-1b1cbd738945 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:01.853276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581028d-f145-4330-a773-3f22007d864e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:01.854198 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581028d-f145-4330-a773-3f22007d864e None admin] REQUEST_METHOD: `PUT` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:01.854485 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581028d-f145-4330-a773-3f22007d864e None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:01.854767 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581028d-f145-4330-a773-3f22007d864e None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243/groups/afdb1abcfd08447faf323424769702e5/roles/abd8e1d1d7cd45cc93ed82f651c74d9b` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:01.859583 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581028d-f145-4330-a773-3f22007d864e None admin] RBAC: Authorizing `identity:create_grant(project_id=6daed429aa5449e2923488e535a6a243, group_id=afdb1abcfd08447faf323424769702e5, role_id=abd8e1d1d7cd45cc93ed82f651c74d9b)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:01.862053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581028d-f145-4330-a773-3f22007d864e None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:01.865163 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 206/395] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:39:01.889640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a2454-1983-459a-88e2-beba3e584c5b None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:01.955928 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 190/396] 10.222.0.62 () {58 vars in 1442 bytes} [Wed May 25 15:39:01 2022] PUT /identity/v3/projects/6daed429aa5449e2923488e535a6a243/groups/afdb1abcfd08447faf323424769702e5/roles/abd8e1d1d7cd45cc93ed82f651c74d9b => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:39:02.023745 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72a2454-1983-459a-88e2-beba3e584c5b None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:02.060720 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:02.078313 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3f80f-b849-46bf-aacc-a730ab88bd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:02.079157 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3f80f-b849-46bf-aacc-a730ab88bd93 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:02.079446 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3f80f-b849-46bf-aacc-a730ab88bd93 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:02.079791 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3f80f-b849-46bf-aacc-a730ab88bd93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:02.097509 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3f80f-b849-46bf-aacc-a730ab88bd93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:02.107305 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-f4a3f80f-b849-46bf-aacc-a730ab88bd93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:39:02.107305 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:02.107305 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:02.107305 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:02.107305 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:02.107305 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:02.107305 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:02.107305 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:02.107305 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:02.107305 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:02.107305 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:02.107305 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:02.107305 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:02.107305 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:02.107305 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:02.107305 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:02.110246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:02.110246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:02.110246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:02.110246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:02.110246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:02.110246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:02.110246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:02.110246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:02.110246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:02.110246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:02.110246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:02.110246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:02.110246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:02.110246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:02.110246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:02.110246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:02.112451 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:02.112451 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:02.112451 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:02.112451 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:02.112451 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:02.112451 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:02.112451 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:02.112451 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:02.112451 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:02.112451 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:02.112451 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:39:02.112451 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:02.112451 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 207/397] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:39:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:02.117322 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581028d-f145-4330-a773-3f22007d864e None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:02.182609 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46ecb6-fb55-4035-a74c-316bf60ae831 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:02.182938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46ecb6-fb55-4035-a74c-316bf60ae831 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:02.183096 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46ecb6-fb55-4035-a74c-316bf60ae831 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:02.185324 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 208/398] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:02.193452 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526f37c-5384-41e3-8b97-d00bd8d0321a None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:02.193759 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526f37c-5384-41e3-8b97-d00bd8d0321a None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:02.194006 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526f37c-5384-41e3-8b97-d00bd8d0321a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:02.213679 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-3526f37c-5384-41e3-8b97-d00bd8d0321a None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:02.214918 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-3526f37c-5384-41e3-8b97-d00bd8d0321a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:02.300746 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581028d-f145-4330-a773-3f22007d864e None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:02.317456 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:02.347000 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe22b60-083a-4e52-b791-e9ad0ed6cd20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:02.348108 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe22b60-083a-4e52-b791-e9ad0ed6cd20 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:02.348213 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 209/399] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:39:02.349030 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe22b60-083a-4e52-b791-e9ad0ed6cd20 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:02.349485 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe22b60-083a-4e52-b791-e9ad0ed6cd20 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:02.350423 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe22b60-083a-4e52-b791-e9ad0ed6cd20 None admin] RBAC: Adding query filter params (name=member) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:02.350926 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe22b60-083a-4e52-b791-e9ad0ed6cd20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:02.352614 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe22b60-083a-4e52-b791-e9ad0ed6cd20 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:02.366684 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 191/400] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:39:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:02.374739 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526f37c-5384-41e3-8b97-d00bd8d0321a None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:02.385117 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe22b60-083a-4e52-b791-e9ad0ed6cd20 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:02.515800 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe22b60-083a-4e52-b791-e9ad0ed6cd20 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:02.521204 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526f37c-5384-41e3-8b97-d00bd8d0321a None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:02.556748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:02.559831 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e4722e-dfa2-47b5-b89a-d986e1e1f88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:02.561012 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4722e-dfa2-47b5-b89a-d986e1e1f88e None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:02.561560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4722e-dfa2-47b5-b89a-d986e1e1f88e None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:02.562017 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e4722e-dfa2-47b5-b89a-d986e1e1f88e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:02.568683 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77582a07-27d0-4aee-ba12-4337f14f7fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:02.569926 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77582a07-27d0-4aee-ba12-4337f14f7fd5 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:02.570350 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77582a07-27d0-4aee-ba12-4337f14f7fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:02.570791 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77582a07-27d0-4aee-ba12-4337f14f7fd5 None admin] PATH_INFO: `/v3/groups/afdb1abcfd08447faf323424769702e5` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:02.572955 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77582a07-27d0-4aee-ba12-4337f14f7fd5 None admin] RBAC: Authorizing `identity:get_group(group_id=afdb1abcfd08447faf323424769702e5)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:02.574571 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77582a07-27d0-4aee-ba12-4337f14f7fd5 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:02.576145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e4722e-dfa2-47b5-b89a-d986e1e1f88e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:02.581548 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 210/401] 10.222.0.62 () {56 vars in 1180 bytes} [Wed May 25 15:39:02 2022] GET /identity/v3/groups/afdb1abcfd08447faf323424769702e5 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:02.583162 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40db10-c8e5-4248-b0da-2c6857455d2d None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:02.583591 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40db10-c8e5-4248-b0da-2c6857455d2d None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:02.584002 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c40db10-c8e5-4248-b0da-2c6857455d2d None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:02.585972 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 211/402] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:02.586848 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40db10-c8e5-4248-b0da-2c6857455d2d None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:02.591020 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-87e4722e-dfa2-47b5-b89a-d986e1e1f88e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:39:02.591020 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:02.591020 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:02.591020 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:02.591020 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:02.591020 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:02.591020 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:02.591020 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:02.591020 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:02.591020 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:02.591020 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:02.591020 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:02.591020 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:02.591020 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:02.591020 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:02.591020 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:02.592112 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:02.592112 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:02.592112 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:02.592112 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:02.592112 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:02.592112 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:02.592112 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:02.592112 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:02.592112 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:02.592112 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:02.592112 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:02.592112 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:02.592112 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:02.592112 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:02.592112 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:02.592112 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:02.593869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:02.593869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:02.593869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:02.593869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:02.593869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:02.593869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:02.593869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:02.593869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:02.593869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:02.593869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:02.593869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:39:02.593869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:02.596152 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 192/403] 10.222.0.62 () {56 vars in 1114 bytes} [Wed May 25 15:39:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:02.597568 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cdb36-087a-410e-939a-ad7e01894142 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:02.602563 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cdb36-087a-410e-939a-ad7e01894142 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:02.602971 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680cdb36-087a-410e-939a-ad7e01894142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:02.627150 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-680cdb36-087a-410e-939a-ad7e01894142 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:02.628679 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-680cdb36-087a-410e-939a-ad7e01894142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:02.664945 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:02.714371 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 193/404] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:39:02.720439 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cdb36-087a-410e-939a-ad7e01894142 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:02.727286 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c40db10-c8e5-4248-b0da-2c6857455d2d None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:02.776491 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867733b-ee7b-487d-9a83-cc36c84eb2c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:02.777285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867733b-ee7b-487d-9a83-cc36c84eb2c4 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:02.777565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867733b-ee7b-487d-9a83-cc36c84eb2c4 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:02.777840 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867733b-ee7b-487d-9a83-cc36c84eb2c4 None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:02.780037 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867733b-ee7b-487d-9a83-cc36c84eb2c4 None admin] RBAC: Authorizing `identity:get_project(project_id=8c22dbab894644ce84024119b5b8a26c)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:02.782225 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867733b-ee7b-487d-9a83-cc36c84eb2c4 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:02.788517 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 212/405] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:39:02 2022] GET /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:02.791400 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867733b-ee7b-487d-9a83-cc36c84eb2c4 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:02.859984 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680cdb36-087a-410e-939a-ad7e01894142 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:02.864957 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:02.911272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3c005-3ee7-4477-a000-82bc71203a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:02.912438 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3c005-3ee7-4477-a000-82bc71203a3d None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:02.912794 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3c005-3ee7-4477-a000-82bc71203a3d None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:02.913090 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e3c005-3ee7-4477-a000-82bc71203a3d None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:02.913896 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3c005-3ee7-4477-a000-82bc71203a3d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:02.914170 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3c005-3ee7-4477-a000-82bc71203a3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:02.915592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e3c005-3ee7-4477-a000-82bc71203a3d None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:02.927841 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 194/406] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:02.930707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3c005-3ee7-4477-a000-82bc71203a3d None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:02.948223 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867733b-ee7b-487d-9a83-cc36c84eb2c4 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:02.974975 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:03.001613 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e1f26-0e40-43b2-9a83-549d07944515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:03.002755 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e1f26-0e40-43b2-9a83-549d07944515 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:03.003037 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e1f26-0e40-43b2-9a83-549d07944515 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:03.003310 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3e1f26-0e40-43b2-9a83-549d07944515 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:03.018745 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3e1f26-0e40-43b2-9a83-549d07944515 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:03.028758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-0a3e1f26-0e40-43b2-9a83-549d07944515 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:39:03.028758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:03.028758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:03.028758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:03.028758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:03.028758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:03.028758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:03.028758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:03.028758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:03.028758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:03.028758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:03.028758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:03.028758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:03.028758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:03.028758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:03.028758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:03.031278 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:03.031278 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:03.031278 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:03.031278 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:03.031278 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:03.031278 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:03.031278 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:03.031278 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:03.031278 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:03.031278 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:03.031278 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:03.031278 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:03.031278 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:03.031278 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:03.031278 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:03.031278 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:03.033421 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:03.033421 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:03.033421 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:03.033421 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:03.033421 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:03.033421 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:03.033421 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:03.033421 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:03.033421 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:03.033421 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:03.033421 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:39:03.033421 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:03.033421 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 213/407] 10.222.0.62 () {56 vars in 1096 bytes} [Wed May 25 15:39:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:03.033421 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e1f26-0e40-43b2-9a83-549d07944515 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:03.088867 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e3c005-3ee7-4477-a000-82bc71203a3d None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:03.139560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f8cff-98a4-42b4-84c1-d33c73bbf10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:03.141121 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f8cff-98a4-42b4-84c1-d33c73bbf10c None admin] REQUEST_METHOD: `PUT` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:03.141496 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f8cff-98a4-42b4-84c1-d33c73bbf10c None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:03.142060 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f8cff-98a4-42b4-84c1-d33c73bbf10c None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c/groups/afdb1abcfd08447faf323424769702e5/roles/5614294f6ab949a99424ee6e983b6430` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:03.144915 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f8cff-98a4-42b4-84c1-d33c73bbf10c None admin] RBAC: Authorizing `identity:create_grant(project_id=8c22dbab894644ce84024119b5b8a26c, group_id=afdb1abcfd08447faf323424769702e5, role_id=5614294f6ab949a99424ee6e983b6430)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:03.146760 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f8cff-98a4-42b4-84c1-d33c73bbf10c None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:03.219016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3e1f26-0e40-43b2-9a83-549d07944515 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:03.229709 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:03.262500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85653fd-f7b0-462d-8003-543164e16749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:03.262500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85653fd-f7b0-462d-8003-543164e16749 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:03.262500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85653fd-f7b0-462d-8003-543164e16749 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:03.262500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85653fd-f7b0-462d-8003-543164e16749 None admin] PATH_INFO: `/v3/groups/afdb1abcfd08447faf323424769702e5` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:03.263154 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85653fd-f7b0-462d-8003-543164e16749 None admin] RBAC: Authorizing `identity:get_group(group_id=afdb1abcfd08447faf323424769702e5)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:03.263154 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85653fd-f7b0-462d-8003-543164e16749 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:03.263770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 195/408] 10.222.0.62 () {58 vars in 1442 bytes} [Wed May 25 15:39:02 2022] PUT /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c/groups/afdb1abcfd08447faf323424769702e5/roles/5614294f6ab949a99424ee6e983b6430 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:39:03.265181 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 214/409] 10.222.0.62 () {56 vars in 1180 bytes} [Wed May 25 15:39:03 2022] GET /identity/v3/groups/afdb1abcfd08447faf323424769702e5 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:03.266038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f8cff-98a4-42b4-84c1-d33c73bbf10c None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:03.277528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85653fd-f7b0-462d-8003-543164e16749 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:03.454285 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:03.481554 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85653fd-f7b0-462d-8003-543164e16749 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:03.492917 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f8cff-98a4-42b4-84c1-d33c73bbf10c None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:03.555348 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba3791-c4bc-43c8-bb9b-e6260b27daf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:03.556121 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba3791-c4bc-43c8-bb9b-e6260b27daf0 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:03.556258 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba3791-c4bc-43c8-bb9b-e6260b27daf0 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:03.556562 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ba3791-c4bc-43c8-bb9b-e6260b27daf0 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:03.557288 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba3791-c4bc-43c8-bb9b-e6260b27daf0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:03.557599 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba3791-c4bc-43c8-bb9b-e6260b27daf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:03.559038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ba3791-c4bc-43c8-bb9b-e6260b27daf0 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:03.569936 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 196/410] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:39:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:03.578164 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba3791-c4bc-43c8-bb9b-e6260b27daf0 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:03.589186 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b1080-088b-4c4a-92c1-8bb3823864d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:03.590083 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b1080-088b-4c4a-92c1-8bb3823864d8 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:03.590374 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b1080-088b-4c4a-92c1-8bb3823864d8 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:03.590736 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9b1080-088b-4c4a-92c1-8bb3823864d8 None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:03.596452 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b1080-088b-4c4a-92c1-8bb3823864d8 None admin] RBAC: Authorizing `identity:get_project(project_id=8c22dbab894644ce84024119b5b8a26c)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:03.597910 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9b1080-088b-4c4a-92c1-8bb3823864d8 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:03.600089 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 215/411] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:39:03 2022] GET /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c => generated 302 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:03.606229 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b1080-088b-4c4a-92c1-8bb3823864d8 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:03.680854 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:03.722041 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ba3791-c4bc-43c8-bb9b-e6260b27daf0 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:03.757267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9b1080-088b-4c4a-92c1-8bb3823864d8 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:03.803173 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f88d3a-0ad5-48df-89e1-971b1b902570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:03.804873 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f88d3a-0ad5-48df-89e1-971b1b902570 None admin] REQUEST_METHOD: `PUT` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:03.805416 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f88d3a-0ad5-48df-89e1-971b1b902570 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:03.805915 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f88d3a-0ad5-48df-89e1-971b1b902570 None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c/groups/afdb1abcfd08447faf323424769702e5/roles/abd8e1d1d7cd45cc93ed82f651c74d9b` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:03.808427 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f88d3a-0ad5-48df-89e1-971b1b902570 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c22dbab894644ce84024119b5b8a26c, group_id=afdb1abcfd08447faf323424769702e5, role_id=abd8e1d1d7cd45cc93ed82f651c74d9b)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:03.810282 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f88d3a-0ad5-48df-89e1-971b1b902570 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:03.821661 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd5a96-b4b6-4ada-bfd5-e3b0291978c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:03.823021 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd5a96-b4b6-4ada-bfd5-e3b0291978c7 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:03.823592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd5a96-b4b6-4ada-bfd5-e3b0291978c7 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:03.824073 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdd5a96-b4b6-4ada-bfd5-e3b0291978c7 None admin] PATH_INFO: `/v3/groups/758c172fe7d0496586e1b13ce929233b` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:03.825861 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd5a96-b4b6-4ada-bfd5-e3b0291978c7 None admin] RBAC: Authorizing `identity:get_group(group_id=758c172fe7d0496586e1b13ce929233b)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:03.828046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdd5a96-b4b6-4ada-bfd5-e3b0291978c7 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:03.835086 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 197/412] 10.222.0.62 () {56 vars in 1180 bytes} [Wed May 25 15:39:03 2022] GET /identity/v3/groups/758c172fe7d0496586e1b13ce929233b => generated 229 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:03.836893 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd5a96-b4b6-4ada-bfd5-e3b0291978c7 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:03.861856 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:03.884363 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 216/413] 10.222.0.62 () {58 vars in 1442 bytes} [Wed May 25 15:39:03 2022] PUT /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c/groups/afdb1abcfd08447faf323424769702e5/roles/abd8e1d1d7cd45cc93ed82f651c74d9b => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:39:03.985778 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdd5a96-b4b6-4ada-bfd5-e3b0291978c7 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:04.027748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff238e68-0b3f-46f9-9fd6-f541132a4a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:04.028765 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff238e68-0b3f-46f9-9fd6-f541132a4a68 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:04.029107 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff238e68-0b3f-46f9-9fd6-f541132a4a68 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:04.029396 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff238e68-0b3f-46f9-9fd6-f541132a4a68 None admin] PATH_INFO: `/v3/projects/7b5e6c2944d540b0b18682f21c8da32d` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:04.031668 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff238e68-0b3f-46f9-9fd6-f541132a4a68 None admin] RBAC: Authorizing `identity:get_project(project_id=7b5e6c2944d540b0b18682f21c8da32d)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:04.033235 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff238e68-0b3f-46f9-9fd6-f541132a4a68 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:04.035042 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 198/414] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:39:03 2022] GET /identity/v3/projects/7b5e6c2944d540b0b18682f21c8da32d => generated 344 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:04.041461 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f88d3a-0ad5-48df-89e1-971b1b902570 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:04.201615 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0359a8-8912-46a2-bdb9-1f0d71d039c2 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:04.202773 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0359a8-8912-46a2-bdb9-1f0d71d039c2 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:04.203487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0359a8-8912-46a2-bdb9-1f0d71d039c2 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:04.206377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 199/415] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:04.211149 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d8b40-ca46-4e51-9449-1f33657c8457 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:04.211958 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d8b40-ca46-4e51-9449-1f33657c8457 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:04.211958 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d8b40-ca46-4e51-9449-1f33657c8457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:04.225695 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f88d3a-0ad5-48df-89e1-971b1b902570 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:04.235114 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:04.238276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-ca4d8b40-ca46-4e51-9449-1f33657c8457 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:04.239723 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-ca4d8b40-ca46-4e51-9449-1f33657c8457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:04.279833 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1243e-5746-46c6-89c8-64700d494a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:04.282960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1243e-5746-46c6-89c8-64700d494a4e None admin] REQUEST_METHOD: `PUT` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:04.283272 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1243e-5746-46c6-89c8-64700d494a4e None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:04.283524 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa1243e-5746-46c6-89c8-64700d494a4e None admin] PATH_INFO: `/v3/projects/7b5e6c2944d540b0b18682f21c8da32d/groups/758c172fe7d0496586e1b13ce929233b/roles/ae72bfdddd1e4a94a21a0d53264ee157` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:04.285823 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1243e-5746-46c6-89c8-64700d494a4e None admin] RBAC: Authorizing `identity:create_grant(project_id=7b5e6c2944d540b0b18682f21c8da32d, group_id=758c172fe7d0496586e1b13ce929233b, role_id=ae72bfdddd1e4a94a21a0d53264ee157)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:04.287312 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa1243e-5746-46c6-89c8-64700d494a4e None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:04.339162 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 200/416] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:39:04.367933 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d8b40-ca46-4e51-9449-1f33657c8457 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:04.386884 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 217/417] 10.222.0.62 () {58 vars in 1442 bytes} [Wed May 25 15:39:04 2022] PUT /identity/v3/projects/7b5e6c2944d540b0b18682f21c8da32d/groups/758c172fe7d0496586e1b13ce929233b/roles/ae72bfdddd1e4a94a21a0d53264ee157 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:39:04.401096 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:04.524542 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d8b40-ca46-4e51-9449-1f33657c8457 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:04.597718 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435c2b0-2853-4dea-88d5-1ae135bceaf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:04.598554 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435c2b0-2853-4dea-88d5-1ae135bceaf3 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:04.598837 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435c2b0-2853-4dea-88d5-1ae135bceaf3 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:04.599137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f435c2b0-2853-4dea-88d5-1ae135bceaf3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:04.616286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f435c2b0-2853-4dea-88d5-1ae135bceaf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:04.628873 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-f435c2b0-2853-4dea-88d5-1ae135bceaf3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:39:04.628873 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:04.628873 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:04.628873 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:04.628873 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:04.628873 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:04.628873 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:04.628873 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:04.628873 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:04.628873 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:04.628873 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:04.628873 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:04.628873 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:04.628873 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:04.628873 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:04.628873 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:04.630528 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:04.630528 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:04.630528 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:04.630528 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:04.630528 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:04.630528 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:04.630528 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:04.630528 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:04.630528 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:04.630528 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:04.630528 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:04.630528 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:04.630528 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:04.630528 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:04.630528 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:04.630528 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:04.631675 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:04.631675 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:04.631675 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:04.631675 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:04.631675 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:04.631675 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:04.631675 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:04.631675 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:04.631675 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:04.631675 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:04.631675 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:39:04.631675 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:04.631675 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 201/418] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:39:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:04.639771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1243e-5746-46c6-89c8-64700d494a4e None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:04.776569 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa1243e-5746-46c6-89c8-64700d494a4e None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:04.823038 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8946307-e732-4eec-9f04-596bb980f560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:04.824573 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8946307-e732-4eec-9f04-596bb980f560 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:04.824863 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8946307-e732-4eec-9f04-596bb980f560 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:04.825123 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8946307-e732-4eec-9f04-596bb980f560 None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:04.825890 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8946307-e732-4eec-9f04-596bb980f560 None admin] RBAC: Adding query filter params (name=member) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:04.826200 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8946307-e732-4eec-9f04-596bb980f560 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:04.828506 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8946307-e732-4eec-9f04-596bb980f560 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:04.838617 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 218/419] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:39:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:04.849575 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435c2b0-2853-4dea-88d5-1ae135bceaf3 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:04.881727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88d042-6d50-4f3f-89ce-de454af61aa8 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:04.882121 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88d042-6d50-4f3f-89ce-de454af61aa8 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:04.882403 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd88d042-6d50-4f3f-89ce-de454af61aa8 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:04.884015 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 219/420] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:39:04.889065 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8423155-3e08-46fe-817e-d11da3a0b1e3 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:04.889332 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8423155-3e08-46fe-817e-d11da3a0b1e3 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:04.889666 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8423155-3e08-46fe-817e-d11da3a0b1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:04.922416 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-a8423155-3e08-46fe-817e-d11da3a0b1e3 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:04.924772 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-a8423155-3e08-46fe-817e-d11da3a0b1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:04.958501 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:05.032893 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:05.046363 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 220/421] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:39:05.080891 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f435c2b0-2853-4dea-88d5-1ae135bceaf3 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:05.097353 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8423155-3e08-46fe-817e-d11da3a0b1e3 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:05.160087 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e751e95-17a1-4f1f-a1fd-285576f32d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:05.160797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e751e95-17a1-4f1f-a1fd-285576f32d29 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:05.161187 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e751e95-17a1-4f1f-a1fd-285576f32d29 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:05.161465 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e751e95-17a1-4f1f-a1fd-285576f32d29 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:05.217596 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8423155-3e08-46fe-817e-d11da3a0b1e3 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:05.258348 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f07a2-410e-4634-8735-625eb7b18e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:05.259166 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f07a2-410e-4634-8735-625eb7b18e27 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:05.259446 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f07a2-410e-4634-8735-625eb7b18e27 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:05.259723 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f07a2-410e-4634-8735-625eb7b18e27 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:05.273652 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f07a2-410e-4634-8735-625eb7b18e27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:05.284859 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-8a7f07a2-410e-4634-8735-625eb7b18e27 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:39:05.284859 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:05.284859 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:05.284859 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:05.284859 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:05.284859 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:05.284859 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:05.284859 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:05.284859 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:05.284859 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:05.284859 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:05.284859 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:05.284859 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:05.284859 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:05.284859 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:05.284859 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:05.285775 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:05.285775 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:05.285775 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:05.285775 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:05.285775 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:05.285775 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:05.285775 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:05.285775 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:05.285775 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:05.285775 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:05.285775 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:05.285775 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:05.285775 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:05.285775 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:05.285775 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:05.285775 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:05.286817 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:05.286817 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:05.286817 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:05.286817 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:05.286817 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:05.286817 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:05.286817 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:05.286817 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:05.286817 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:05.286817 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:05.286817 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:39:05.286817 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:05.286817 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 221/422] 10.222.0.62 () {56 vars in 1114 bytes} [Wed May 25 15:39:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:39:05.291836 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f07a2-410e-4634-8735-625eb7b18e27 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:05.317353 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e751e95-17a1-4f1f-a1fd-285576f32d29 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:05.319202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e751e95-17a1-4f1f-a1fd-285576f32d29 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:05.322347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:05.418805 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f07a2-410e-4634-8735-625eb7b18e27 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:05.465297 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae812f-0673-49ee-a44f-f33b13a5746d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:05.465982 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae812f-0673-49ee-a44f-f33b13a5746d None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:05.466262 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae812f-0673-49ee-a44f-f33b13a5746d None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:05.466537 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ae812f-0673-49ee-a44f-f33b13a5746d None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:05.467290 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae812f-0673-49ee-a44f-f33b13a5746d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:05.467622 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae812f-0673-49ee-a44f-f33b13a5746d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:05.469448 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ae812f-0673-49ee-a44f-f33b13a5746d None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:05.489714 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 222/423] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:05.495446 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae812f-0673-49ee-a44f-f33b13a5746d None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:05.516856 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:05.543149 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 202/424] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:39:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 694 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:39:05.549452 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e751e95-17a1-4f1f-a1fd-285576f32d29 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:05.670991 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e751e95-17a1-4f1f-a1fd-285576f32d29 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:05.682558 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:05.714060 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ae812f-0673-49ee-a44f-f33b13a5746d None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:05.714379 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d32c3-c278-4f7b-a015-0f0265374858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:05.715244 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d32c3-c278-4f7b-a015-0f0265374858 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:05.715672 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d32c3-c278-4f7b-a015-0f0265374858 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:05.715954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d32c3-c278-4f7b-a015-0f0265374858 None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:05.721529 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d32c3-c278-4f7b-a015-0f0265374858 None admin] RBAC: Authorizing `identity:get_project(project_id=6daed429aa5449e2923488e535a6a243)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:05.723029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44d32c3-c278-4f7b-a015-0f0265374858 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:05.726147 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 203/425] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:39:05 2022] GET /identity/v3/projects/6daed429aa5449e2923488e535a6a243 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:05.731859 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d32c3-c278-4f7b-a015-0f0265374858 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:05.766388 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db8f10-e7bd-4e59-8c4b-ac7668a89758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:05.767049 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db8f10-e7bd-4e59-8c4b-ac7668a89758 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:05.767329 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db8f10-e7bd-4e59-8c4b-ac7668a89758 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:05.767602 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83db8f10-e7bd-4e59-8c4b-ac7668a89758 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:05.842145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:05.850268 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db8f10-e7bd-4e59-8c4b-ac7668a89758 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:05.855174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83db8f10-e7bd-4e59-8c4b-ac7668a89758 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:05.949330 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:05.975326 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 223/426] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:39:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 480 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 15:39:05.982896 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db8f10-e7bd-4e59-8c4b-ac7668a89758 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:05.989851 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44d32c3-c278-4f7b-a015-0f0265374858 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:06.030787 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132ba1c-45a4-4445-a181-71e2ac733eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:06.032018 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132ba1c-45a4-4445-a181-71e2ac733eae None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:06.032540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132ba1c-45a4-4445-a181-71e2ac733eae None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:06.033015 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f132ba1c-45a4-4445-a181-71e2ac733eae None admin] PATH_INFO: `/v3/groups/afdb1abcfd08447faf323424769702e5` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:06.034488 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132ba1c-45a4-4445-a181-71e2ac733eae None admin] RBAC: Authorizing `identity:get_group(group_id=afdb1abcfd08447faf323424769702e5)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:06.036194 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f132ba1c-45a4-4445-a181-71e2ac733eae None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:06.043347 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 204/427] 10.222.0.62 () {56 vars in 1180 bytes} [Wed May 25 15:39:05 2022] GET /identity/v3/groups/afdb1abcfd08447faf323424769702e5 => generated 226 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:06.045120 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132ba1c-45a4-4445-a181-71e2ac733eae None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:06.171200 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f132ba1c-45a4-4445-a181-71e2ac733eae None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:06.182030 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83db8f10-e7bd-4e59-8c4b-ac7668a89758 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:06.183756 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:06.211512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9738a-ec80-4a29-947d-3ee3ba23781f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:06.212631 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9738a-ec80-4a29-947d-3ee3ba23781f None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:06.213119 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9738a-ec80-4a29-947d-3ee3ba23781f None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:06.213612 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9738a-ec80-4a29-947d-3ee3ba23781f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:06.214641 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9738a-ec80-4a29-947d-3ee3ba23781f None admin] RBAC: Adding query filter params (group.id=afdb1abcfd08447faf323424769702e5, role.id=5614294f6ab949a99424ee6e983b6430, scope.project.id=6daed429aa5449e2923488e535a6a243) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:06.215174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9738a-ec80-4a29-947d-3ee3ba23781f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:06.216841 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9738a-ec80-4a29-947d-3ee3ba23781f None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:06.232555 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 205/428] 10.222.0.62 () {56 vars in 1376 bytes} [Wed May 25 15:39:06 2022] GET /identity/v3/role_assignments?group.id=afdb1abcfd08447faf323424769702e5&scope.project.id=6daed429aa5449e2923488e535a6a243&role.id=5614294f6ab949a99424ee6e983b6430 => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:06.232555 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7632b40-51cd-414f-a637-c0a5b0c7bfeb None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:06.232555 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7632b40-51cd-414f-a637-c0a5b0c7bfeb None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:06.232555 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7632b40-51cd-414f-a637-c0a5b0c7bfeb None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:06.232555 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 206/429] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:06.241365 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fc00b-bf62-4341-9d31-28eacaa706f5 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:06.241698 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fc00b-bf62-4341-9d31-28eacaa706f5 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:06.241923 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58fc00b-bf62-4341-9d31-28eacaa706f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:06.244056 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55af47a-a2a6-441d-82c8-537787667f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:06.244968 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55af47a-a2a6-441d-82c8-537787667f7f None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:06.245247 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55af47a-a2a6-441d-82c8-537787667f7f None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:06.245517 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55af47a-a2a6-441d-82c8-537787667f7f None admin] PATH_INFO: `/v3/projects/6daed429aa5449e2923488e535a6a243` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:06.247314 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55af47a-a2a6-441d-82c8-537787667f7f None admin] RBAC: Authorizing `identity:get_project(project_id=6daed429aa5449e2923488e535a6a243)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:06.249368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55af47a-a2a6-441d-82c8-537787667f7f None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:06.260458 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 224/430] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:39:05 2022] GET /identity/v3/projects/6daed429aa5449e2923488e535a6a243 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:06.261438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55af47a-a2a6-441d-82c8-537787667f7f None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:06.284005 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-b58fc00b-bf62-4341-9d31-28eacaa706f5 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:06.287640 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-b58fc00b-bf62-4341-9d31-28eacaa706f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:06.376911 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:06.458050 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 207/431] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:39:06.478551 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55af47a-a2a6-441d-82c8-537787667f7f None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:06.510327 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fc00b-bf62-4341-9d31-28eacaa706f5 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:06.522098 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f3c97-566f-4d59-8c19-098aa5aa6e8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:06.523268 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f3c97-566f-4d59-8c19-098aa5aa6e8e None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:06.523728 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f3c97-566f-4d59-8c19-098aa5aa6e8e None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:06.524213 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075f3c97-566f-4d59-8c19-098aa5aa6e8e None admin] PATH_INFO: `/v3/groups/afdb1abcfd08447faf323424769702e5` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:06.525743 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f3c97-566f-4d59-8c19-098aa5aa6e8e None admin] RBAC: Authorizing `identity:get_group(group_id=afdb1abcfd08447faf323424769702e5)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:06.527383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075f3c97-566f-4d59-8c19-098aa5aa6e8e None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:06.530031 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 225/432] 10.222.0.62 () {56 vars in 1180 bytes} [Wed May 25 15:39:06 2022] GET /identity/v3/groups/afdb1abcfd08447faf323424769702e5 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:06.542985 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f3c97-566f-4d59-8c19-098aa5aa6e8e None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:06.664704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58fc00b-bf62-4341-9d31-28eacaa706f5 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:06.668447 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:06.706079 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075f3c97-566f-4d59-8c19-098aa5aa6e8e None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:06.712036 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f980f0f-06fc-4b7d-a394-358a237672d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:06.713501 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f980f0f-06fc-4b7d-a394-358a237672d3 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:06.713968 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f980f0f-06fc-4b7d-a394-358a237672d3 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:06.714442 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f980f0f-06fc-4b7d-a394-358a237672d3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:06.727855 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:06.733081 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f980f0f-06fc-4b7d-a394-358a237672d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:06.742513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-7f980f0f-06fc-4b7d-a394-358a237672d3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 15:39:06.742513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:06.742513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:06.742513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:06.742513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:06.742513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:06.742513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:06.742513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:06.742513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:06.742513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:06.742513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:06.742513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:06.742513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:06.742513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:06.742513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:06.742513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:06.743474 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:06.743474 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:06.743474 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:06.743474 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:06.743474 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:06.743474 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:06.743474 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:06.743474 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:06.743474 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:06.743474 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:06.743474 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:06.743474 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:06.743474 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:06.743474 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:06.743474 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:06.743474 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:06.744257 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:06.744257 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:06.744257 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:06.744257 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:06.744257 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:06.744257 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:06.744257 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:06.744257 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:06.744257 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:06.744257 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:06.744257 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 15:39:06.744257 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:06.747398 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 208/433] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:39:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:06.756146 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f980f0f-06fc-4b7d-a394-358a237672d3 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:06.766387 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7df815-e632-4e0a-8ba7-442edc29eb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:06.767110 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7df815-e632-4e0a-8ba7-442edc29eb50 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:06.767405 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7df815-e632-4e0a-8ba7-442edc29eb50 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:06.767688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7df815-e632-4e0a-8ba7-442edc29eb50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:06.769789 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7df815-e632-4e0a-8ba7-442edc29eb50 None admin] RBAC: Adding query filter params (group.id=afdb1abcfd08447faf323424769702e5, role.id=abd8e1d1d7cd45cc93ed82f651c74d9b, scope.project.id=6daed429aa5449e2923488e535a6a243) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:06.770205 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7df815-e632-4e0a-8ba7-442edc29eb50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:06.771749 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7df815-e632-4e0a-8ba7-442edc29eb50 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:06.781474 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 226/434] 10.222.0.62 () {56 vars in 1376 bytes} [Wed May 25 15:39:06 2022] GET /identity/v3/role_assignments?group.id=afdb1abcfd08447faf323424769702e5&scope.project.id=6daed429aa5449e2923488e535a6a243&role.id=abd8e1d1d7cd45cc93ed82f651c74d9b => generated 611 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:06.888967 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f980f0f-06fc-4b7d-a394-358a237672d3 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:06.935479 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ea977a-3822-4835-9885-923d41ec24c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:06.936185 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea977a-3822-4835-9885-923d41ec24c2 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:06.937165 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea977a-3822-4835-9885-923d41ec24c2 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:06.937624 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ea977a-3822-4835-9885-923d41ec24c2 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:06.938380 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea977a-3822-4835-9885-923d41ec24c2 None admin] RBAC: Adding query filter params (name=member) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:06.938697 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea977a-3822-4835-9885-923d41ec24c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:06.940137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ea977a-3822-4835-9885-923d41ec24c2 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:06.953271 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 209/435] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:39:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:06.959576 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7df815-e632-4e0a-8ba7-442edc29eb50 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:07.008829 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a16d0-9f53-4461-a024-8caae46003c0 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:07.009080 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a16d0-9f53-4461-a024-8caae46003c0 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:07.009423 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6a16d0-9f53-4461-a024-8caae46003c0 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:07.010964 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 210/436] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:07.016736 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b7f3f-60dc-40bf-88d1-86e96fc454b9 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:07.017067 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b7f3f-60dc-40bf-88d1-86e96fc454b9 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:07.017303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916b7f3f-60dc-40bf-88d1-86e96fc454b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:07.042842 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-916b7f3f-60dc-40bf-88d1-86e96fc454b9 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:07.044069 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-916b7f3f-60dc-40bf-88d1-86e96fc454b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:07.072520 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:07.123070 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7df815-e632-4e0a-8ba7-442edc29eb50 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:07.156803 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 211/437] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:39:07.183958 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b7f3f-60dc-40bf-88d1-86e96fc454b9 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:07.187803 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2322960-794b-4135-86f6-887087ec2581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:07.188837 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2322960-794b-4135-86f6-887087ec2581 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:07.189334 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2322960-794b-4135-86f6-887087ec2581 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:07.189809 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2322960-794b-4135-86f6-887087ec2581 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:07.279290 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:07.316461 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2322960-794b-4135-86f6-887087ec2581 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:07.317960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2322960-794b-4135-86f6-887087ec2581 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:07.353393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916b7f3f-60dc-40bf-88d1-86e96fc454b9 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:07.408795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0d9f7-1a93-481b-8349-cb3626b8cb61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:07.409958 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0d9f7-1a93-481b-8349-cb3626b8cb61 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:07.410394 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0d9f7-1a93-481b-8349-cb3626b8cb61 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:07.410807 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0d9f7-1a93-481b-8349-cb3626b8cb61 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:07.431165 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda0d9f7-1a93-481b-8349-cb3626b8cb61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:07.443974 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-eda0d9f7-1a93-481b-8349-cb3626b8cb61 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:39:07.443974 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:07.443974 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:07.443974 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:07.443974 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:07.443974 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:07.443974 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:07.443974 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:07.443974 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:07.443974 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:07.443974 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:07.443974 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:07.443974 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:07.443974 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:07.443974 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:07.443974 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:07.445802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:07.445802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:07.445802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:07.445802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:07.445802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:07.445802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:07.445802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:07.445802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:07.445802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:07.445802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:07.445802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:07.445802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:07.445802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:07.445802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:07.445802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:07.445802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:07.447361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:07.447361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:07.447361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:07.447361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:07.447361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:07.447361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:07.447361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:07.447361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:07.447361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:07.447361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:07.447361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 15:39:07.447361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:07.454062 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 212/438] 10.222.0.62 () {56 vars in 1114 bytes} [Wed May 25 15:39:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:39:07.454062 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e91fb-5884-491d-ac7d-641c57dafff0 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:07.454062 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e91fb-5884-491d-ac7d-641c57dafff0 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:07.454062 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e91fb-5884-491d-ac7d-641c57dafff0 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:07.454062 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 213/439] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:07.459581 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e91fb-5884-491d-ac7d-641c57dafff0 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:07.481405 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:07.484501 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 227/440] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:39:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 15:39:07.486798 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac49b94-3349-4cb7-9fcc-46998ed3d0b9 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:07.487483 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac49b94-3349-4cb7-9fcc-46998ed3d0b9 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:07.488117 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac49b94-3349-4cb7-9fcc-46998ed3d0b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:07.507137 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-dac49b94-3349-4cb7-9fcc-46998ed3d0b9 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:07.508323 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-dac49b94-3349-4cb7-9fcc-46998ed3d0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:07.572148 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e91fb-5884-491d-ac7d-641c57dafff0 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:07.576685 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 228/441] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:39:07.578515 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac49b94-3349-4cb7-9fcc-46998ed3d0b9 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:07.591004 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:07.607476 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5da45b-90d5-466e-af86-65667d25af9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:07.608151 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5da45b-90d5-466e-af86-65667d25af9d None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:07.608664 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5da45b-90d5-466e-af86-65667d25af9d None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:07.609078 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5da45b-90d5-466e-af86-65667d25af9d None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:07.609836 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5da45b-90d5-466e-af86-65667d25af9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:07.610148 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5da45b-90d5-466e-af86-65667d25af9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:07.611526 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5da45b-90d5-466e-af86-65667d25af9d None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:07.619765 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 214/442] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:07.621488 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5da45b-90d5-466e-af86-65667d25af9d None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:07.679760 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac49b94-3349-4cb7-9fcc-46998ed3d0b9 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:07.703715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:07.715352 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e81266-e7e0-4035-a13f-02e6856cf43e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:07.716212 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e81266-e7e0-4035-a13f-02e6856cf43e None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:07.725390 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e81266-e7e0-4035-a13f-02e6856cf43e None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:07.725390 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e81266-e7e0-4035-a13f-02e6856cf43e None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:07.725390 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e81266-e7e0-4035-a13f-02e6856cf43e None admin] RBAC: Authorizing `identity:get_project(project_id=8c22dbab894644ce84024119b5b8a26c)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:07.725390 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e81266-e7e0-4035-a13f-02e6856cf43e None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:07.725390 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 229/443] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:39:07 2022] GET /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:07.725390 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e81266-e7e0-4035-a13f-02e6856cf43e None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:07.725873 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5da45b-90d5-466e-af86-65667d25af9d None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:07.759987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782891f-b354-43af-810b-b273796c8f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:07.760856 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782891f-b354-43af-810b-b273796c8f48 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:07.761170 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782891f-b354-43af-810b-b273796c8f48 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:07.761446 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1782891f-b354-43af-810b-b273796c8f48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:07.773047 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1782891f-b354-43af-810b-b273796c8f48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:07.781645 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-1782891f-b354-43af-810b-b273796c8f48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:39:07.781645 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:07.781645 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:07.781645 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:07.781645 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:07.781645 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:07.781645 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:07.781645 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:07.781645 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:07.781645 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:07.781645 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:07.781645 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:07.781645 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:07.781645 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:07.781645 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:07.781645 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:07.783983 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:07.783983 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:07.783983 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:07.783983 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:07.783983 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:07.783983 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:07.783983 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:07.783983 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:07.783983 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:07.783983 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:07.783983 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:07.783983 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:07.783983 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:07.783983 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:07.783983 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:07.783983 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:07.784802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:07.784802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:07.784802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:07.784802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:07.784802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:07.784802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:07.784802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:07.784802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:07.784802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:07.784802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:07.784802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:39:07.784802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:07.784802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 215/444] 10.222.0.62 () {56 vars in 1096 bytes} [Wed May 25 15:39:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:07.784802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782891f-b354-43af-810b-b273796c8f48 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:07.809222 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:07.831599 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e81266-e7e0-4035-a13f-02e6856cf43e None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:07.867017 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4944a-705b-4c38-b384-b10a7511339d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:07.867675 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4944a-705b-4c38-b384-b10a7511339d None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:07.867965 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4944a-705b-4c38-b384-b10a7511339d None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:07.868316 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b4944a-705b-4c38-b384-b10a7511339d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:07.890606 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1782891f-b354-43af-810b-b273796c8f48 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:07.925187 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc04f6-c1c2-40a1-9947-f2abaabd9017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:07.926037 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc04f6-c1c2-40a1-9947-f2abaabd9017 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:07.926317 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc04f6-c1c2-40a1-9947-f2abaabd9017 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:07.926623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cc04f6-c1c2-40a1-9947-f2abaabd9017 None admin] PATH_INFO: `/v3/groups/afdb1abcfd08447faf323424769702e5` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:07.927812 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc04f6-c1c2-40a1-9947-f2abaabd9017 None admin] RBAC: Authorizing `identity:get_group(group_id=afdb1abcfd08447faf323424769702e5)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:07.929408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cc04f6-c1c2-40a1-9947-f2abaabd9017 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:07.931019 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 216/445] 10.222.0.62 () {56 vars in 1180 bytes} [Wed May 25 15:39:07 2022] GET /identity/v3/groups/afdb1abcfd08447faf323424769702e5 => generated 226 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:07.931772 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc04f6-c1c2-40a1-9947-f2abaabd9017 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:07.943047 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:07.943229 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4944a-705b-4c38-b384-b10a7511339d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:07.944600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b4944a-705b-4c38-b384-b10a7511339d None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:08.024428 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:08.037141 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cc04f6-c1c2-40a1-9947-f2abaabd9017 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:08.046848 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 230/446] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:39:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:39:08.047684 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4944a-705b-4c38-b384-b10a7511339d None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:08.071651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bd214-ed70-4153-a281-cae70ed9fca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:08.072321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bd214-ed70-4153-a281-cae70ed9fca4 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:08.072634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bd214-ed70-4153-a281-cae70ed9fca4 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:08.072921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9bd214-ed70-4153-a281-cae70ed9fca4 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:08.073659 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bd214-ed70-4153-a281-cae70ed9fca4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:08.073968 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bd214-ed70-4153-a281-cae70ed9fca4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:08.075543 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9bd214-ed70-4153-a281-cae70ed9fca4 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:08.084591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 217/447] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:39:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:08.085333 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bd214-ed70-4153-a281-cae70ed9fca4 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:08.153372 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:08.154576 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b4944a-705b-4c38-b384-b10a7511339d None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:08.187328 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9bd214-ed70-4153-a281-cae70ed9fca4 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:08.190294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fe4c2-2cda-4118-a631-080436127cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:08.190949 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fe4c2-2cda-4118-a631-080436127cc2 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:08.191231 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fe4c2-2cda-4118-a631-080436127cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:08.191505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fe4c2-2cda-4118-a631-080436127cc2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:08.192338 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fe4c2-2cda-4118-a631-080436127cc2 None admin] RBAC: Adding query filter params (group.id=afdb1abcfd08447faf323424769702e5, role.id=5614294f6ab949a99424ee6e983b6430, scope.project.id=8c22dbab894644ce84024119b5b8a26c) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:08.192681 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fe4c2-2cda-4118-a631-080436127cc2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:08.194136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fe4c2-2cda-4118-a631-080436127cc2 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:08.200227 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 231/448] 10.222.0.62 () {56 vars in 1376 bytes} [Wed May 25 15:39:08 2022] GET /identity/v3/role_assignments?group.id=afdb1abcfd08447faf323424769702e5&scope.project.id=8c22dbab894644ce84024119b5b8a26c&role.id=5614294f6ab949a99424ee6e983b6430 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:08.200835 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fe4c2-2cda-4118-a631-080436127cc2 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:08.227102 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd4a01-d6e8-491d-8cb5-52bb7471adc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:08.228004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd4a01-d6e8-491d-8cb5-52bb7471adc8 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:08.228295 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd4a01-d6e8-491d-8cb5-52bb7471adc8 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:08.228611 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd4a01-d6e8-491d-8cb5-52bb7471adc8 None admin] PATH_INFO: `/v3/projects/8c22dbab894644ce84024119b5b8a26c` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:08.229917 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd4a01-d6e8-491d-8cb5-52bb7471adc8 None admin] RBAC: Authorizing `identity:get_project(project_id=8c22dbab894644ce84024119b5b8a26c)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:08.231556 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fcd4a01-d6e8-491d-8cb5-52bb7471adc8 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:08.238855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 218/449] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:39:08 2022] GET /identity/v3/projects/8c22dbab894644ce84024119b5b8a26c => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:08.240058 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd4a01-d6e8-491d-8cb5-52bb7471adc8 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:08.268789 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:08.336979 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fe4c2-2cda-4118-a631-080436127cc2 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:08.356349 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd4a01-d6e8-491d-8cb5-52bb7471adc8 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:08.375916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024f84c-99ca-4b98-929c-d6fdf7efe4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:08.376616 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024f84c-99ca-4b98-929c-d6fdf7efe4bb None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:08.376904 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024f84c-99ca-4b98-929c-d6fdf7efe4bb None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:08.377183 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8024f84c-99ca-4b98-929c-d6fdf7efe4bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:08.397817 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c812e63-f7b9-4ab1-91cd-a51d406a81c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:08.398256 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c812e63-f7b9-4ab1-91cd-a51d406a81c5 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:08.398543 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c812e63-f7b9-4ab1-91cd-a51d406a81c5 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:08.398823 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c812e63-f7b9-4ab1-91cd-a51d406a81c5 None admin] PATH_INFO: `/v3/groups/afdb1abcfd08447faf323424769702e5` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:08.400070 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c812e63-f7b9-4ab1-91cd-a51d406a81c5 None admin] RBAC: Authorizing `identity:get_group(group_id=afdb1abcfd08447faf323424769702e5)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:08.401577 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c812e63-f7b9-4ab1-91cd-a51d406a81c5 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:08.403585 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 219/450] 10.222.0.62 () {56 vars in 1180 bytes} [Wed May 25 15:39:08 2022] GET /identity/v3/groups/afdb1abcfd08447faf323424769702e5 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:08.410734 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c812e63-f7b9-4ab1-91cd-a51d406a81c5 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:08.415251 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:08.461328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024f84c-99ca-4b98-929c-d6fdf7efe4bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:08.462825 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8024f84c-99ca-4b98-929c-d6fdf7efe4bb None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:08.516840 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:08.539802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c812e63-f7b9-4ab1-91cd-a51d406a81c5 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:08.579727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc27456-c09c-4a4a-81be-b47c075fbf85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:08.580390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc27456-c09c-4a4a-81be-b47c075fbf85 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:08.580730 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc27456-c09c-4a4a-81be-b47c075fbf85 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:08.581007 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc27456-c09c-4a4a-81be-b47c075fbf85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:08.581971 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc27456-c09c-4a4a-81be-b47c075fbf85 None admin] RBAC: Adding query filter params (group.id=afdb1abcfd08447faf323424769702e5, role.id=abd8e1d1d7cd45cc93ed82f651c74d9b, scope.project.id=8c22dbab894644ce84024119b5b8a26c) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:08.582223 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc27456-c09c-4a4a-81be-b47c075fbf85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:08.583614 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc27456-c09c-4a4a-81be-b47c075fbf85 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:08.586019 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 232/451] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:39:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:39:08.592083 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024f84c-99ca-4b98-929c-d6fdf7efe4bb None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:08.592244 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 220/452] 10.222.0.62 () {56 vars in 1376 bytes} [Wed May 25 15:39:08 2022] GET /identity/v3/role_assignments?group.id=afdb1abcfd08447faf323424769702e5&scope.project.id=8c22dbab894644ce84024119b5b8a26c&role.id=abd8e1d1d7cd45cc93ed82f651c74d9b => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:08.704376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8024f84c-99ca-4b98-929c-d6fdf7efe4bb None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:08.740756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac575ae-18cc-43b2-98a4-449f5b9e51cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:08.741661 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac575ae-18cc-43b2-98a4-449f5b9e51cd None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:08.741946 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac575ae-18cc-43b2-98a4-449f5b9e51cd None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:08.742222 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac575ae-18cc-43b2-98a4-449f5b9e51cd None admin] PATH_INFO: `/v3/projects/7b5e6c2944d540b0b18682f21c8da32d` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:08.743468 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac575ae-18cc-43b2-98a4-449f5b9e51cd None admin] RBAC: Authorizing `identity:get_project(project_id=7b5e6c2944d540b0b18682f21c8da32d)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:08.744975 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac575ae-18cc-43b2-98a4-449f5b9e51cd None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:08.746886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 233/453] 10.222.0.62 () {56 vars in 1186 bytes} [Wed May 25 15:39:08 2022] GET /identity/v3/projects/7b5e6c2944d540b0b18682f21c8da32d => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:08.752668 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc27456-c09c-4a4a-81be-b47c075fbf85 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:08.822675 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:08.856651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc27456-c09c-4a4a-81be-b47c075fbf85 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:08.890982 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695cb26-8326-404f-b744-06242f207836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:08.891878 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695cb26-8326-404f-b744-06242f207836 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:08.892163 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695cb26-8326-404f-b744-06242f207836 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:08.892462 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695cb26-8326-404f-b744-06242f207836 None admin] PATH_INFO: `/v3/groups/758c172fe7d0496586e1b13ce929233b` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:08.893651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695cb26-8326-404f-b744-06242f207836 None admin] RBAC: Authorizing `identity:get_group(group_id=758c172fe7d0496586e1b13ce929233b)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:08.895360 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695cb26-8326-404f-b744-06242f207836 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:08.897089 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 221/454] 10.222.0.62 () {56 vars in 1180 bytes} [Wed May 25 15:39:08 2022] GET /identity/v3/groups/758c172fe7d0496586e1b13ce929233b => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:08.903221 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac575ae-18cc-43b2-98a4-449f5b9e51cd None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:08.917039 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:09.009028 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac575ae-18cc-43b2-98a4-449f5b9e51cd None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:09.043301 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b91689-f7f9-4bd6-95d0-fcd2fbad937d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:09.043947 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b91689-f7f9-4bd6-95d0-fcd2fbad937d None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:09.044228 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b91689-f7f9-4bd6-95d0-fcd2fbad937d None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:09.044531 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b91689-f7f9-4bd6-95d0-fcd2fbad937d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:09.045357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b91689-f7f9-4bd6-95d0-fcd2fbad937d None admin] RBAC: Adding query filter params (group.id=758c172fe7d0496586e1b13ce929233b, role.id=ae72bfdddd1e4a94a21a0d53264ee157, scope.project.id=7b5e6c2944d540b0b18682f21c8da32d) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:09.045691 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b91689-f7f9-4bd6-95d0-fcd2fbad937d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:09.047344 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b91689-f7f9-4bd6-95d0-fcd2fbad937d None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:09.053105 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 234/455] 10.222.0.62 () {56 vars in 1376 bytes} [Wed May 25 15:39:08 2022] GET /identity/v3/role_assignments?group.id=758c172fe7d0496586e1b13ce929233b&scope.project.id=7b5e6c2944d540b0b18682f21c8da32d&role.id=ae72bfdddd1e4a94a21a0d53264ee157 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:11.690604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a1a95-6f10-4adc-ab47-b76240b9dab6 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:11.691192 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a1a95-6f10-4adc-ab47-b76240b9dab6 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:11.691192 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40a1a95-6f10-4adc-ab47-b76240b9dab6 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:11.692845 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 222/456] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:11.698184 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077da8a-d8d7-4ae0-acbd-86ca3d5b6f62 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:11.704208 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077da8a-d8d7-4ae0-acbd-86ca3d5b6f62 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:11.704208 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077da8a-d8d7-4ae0-acbd-86ca3d5b6f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:11.717402 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-f077da8a-d8d7-4ae0-acbd-86ca3d5b6f62 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:11.719160 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-f077da8a-d8d7-4ae0-acbd-86ca3d5b6f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:11.791563 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 235/457] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:39:11.819598 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a1a95-6f10-4adc-ab47-b76240b9dab6 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:11.834730 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1215c-22c9-4b97-8408-65fbb9c40f22 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:11.835053 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1215c-22c9-4b97-8408-65fbb9c40f22 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:11.835283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f1215c-22c9-4b97-8408-65fbb9c40f22 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:11.836933 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 236/458] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:39:11.846003 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbceaa-8d7d-41dc-a15d-822b4ad88994 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:11.846633 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbceaa-8d7d-41dc-a15d-822b4ad88994 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:11.847061 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dbceaa-8d7d-41dc-a15d-822b4ad88994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:11.854641 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:11.867219 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-64dbceaa-8d7d-41dc-a15d-822b4ad88994 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:11.868916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-64dbceaa-8d7d-41dc-a15d-822b4ad88994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:11.948666 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 237/459] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:39:11.949219 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40a1a95-6f10-4adc-ab47-b76240b9dab6 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:11.973729 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbceaa-8d7d-41dc-a15d-822b4ad88994 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:11.989011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec21816-aa07-4436-8c5d-dad736f670b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:11.990018 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec21816-aa07-4436-8c5d-dad736f670b1 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:11.990477 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec21816-aa07-4436-8c5d-dad736f670b1 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:11.990905 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec21816-aa07-4436-8c5d-dad736f670b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:11.994585 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:12.004195 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec21816-aa07-4436-8c5d-dad736f670b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:12.007539 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec21816-aa07-4436-8c5d-dad736f670b1 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:12.025881 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-8ec21816-aa07-4436-8c5d-dad736f670b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:12.025881 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:12.025881 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:12.025881 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:12.025881 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:12.025881 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:12.025881 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:12.025881 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:12.025881 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:12.025881 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:12.025881 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:12.025881 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:12.025881 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:12.025881 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:12.025881 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:12.027002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:12.027002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:12.027002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:12.027002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:12.027002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:12.027002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:12.027002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:12.027002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:12.027002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:12.027002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:12.027002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:12.027002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:12.027002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:12.027002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:12.027002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:12.027002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:12.027002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:12.028180 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:12.028180 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:12.028180 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:12.028180 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:12.031465 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 223/460] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:12.037178 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec21816-aa07-4436-8c5d-dad736f670b1 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:12.098838 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dbceaa-8d7d-41dc-a15d-822b4ad88994 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:12.145504 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7639fe23-7de5-40c3-9579-ce948ca842cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:12.146393 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639fe23-7de5-40c3-9579-ce948ca842cf None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:12.146744 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639fe23-7de5-40c3-9579-ce948ca842cf None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:12.147089 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7639fe23-7de5-40c3-9579-ce948ca842cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:12.149661 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:12.159283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639fe23-7de5-40c3-9579-ce948ca842cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:12.160983 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7639fe23-7de5-40c3-9579-ce948ca842cf None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:12.165994 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec21816-aa07-4436-8c5d-dad736f670b1 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:12.179923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-7639fe23-7de5-40c3-9579-ce948ca842cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:12.179923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:12.179923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:12.179923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:12.179923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:12.179923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:12.179923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:12.179923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:12.179923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:12.179923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:12.179923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:12.179923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:12.179923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:12.179923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:12.179923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:12.180917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:12.180917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:12.180917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:12.180917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:12.180917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:12.180917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:12.180917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:12.180917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:12.180917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:12.180917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:12.180917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:12.180917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:12.180917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:12.180917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:12.180917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:12.180917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:12.180917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:12.187375 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:12.187375 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:12.187375 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:12.187375 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:12.187375 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 238/461] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:39:12.187375 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd08101-19cd-495d-a4d1-29fd31450fc7 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:12.187375 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd08101-19cd-495d-a4d1-29fd31450fc7 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:12.187375 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd08101-19cd-495d-a4d1-29fd31450fc7 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:12.189501 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 239/462] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:12.190288 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd08101-19cd-495d-a4d1-29fd31450fc7 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:12.204152 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3de08-5a9e-46f0-aa18-81e4b46844ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:12.204832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3de08-5a9e-46f0-aa18-81e4b46844ce None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:12.205123 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3de08-5a9e-46f0-aa18-81e4b46844ce None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:12.205398 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3de08-5a9e-46f0-aa18-81e4b46844ce None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:12.206424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3de08-5a9e-46f0-aa18-81e4b46844ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:12.206424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3de08-5a9e-46f0-aa18-81e4b46844ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:12.207773 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3de08-5a9e-46f0-aa18-81e4b46844ce None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:12.225274 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 224/463] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:12.226608 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e97167-45f3-4a8a-b8a4-5f64687c2224 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:12.226899 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e97167-45f3-4a8a-b8a4-5f64687c2224 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:12.227176 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e97167-45f3-4a8a-b8a4-5f64687c2224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:12.244236 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-90e97167-45f3-4a8a-b8a4-5f64687c2224 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:12.245464 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-90e97167-45f3-4a8a-b8a4-5f64687c2224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:12.294726 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:12.303764 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd08101-19cd-495d-a4d1-29fd31450fc7 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:12.318496 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 225/464] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:39:12.319277 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e97167-45f3-4a8a-b8a4-5f64687c2224 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:12.339842 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf5f79d-362a-4e12-bf12-942ce345fa15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:12.340605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5f79d-362a-4e12-bf12-942ce345fa15 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:12.340821 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5f79d-362a-4e12-bf12-942ce345fa15 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:12.341095 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf5f79d-362a-4e12-bf12-942ce345fa15 None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:12.341823 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5f79d-362a-4e12-bf12-942ce345fa15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:12.342246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5f79d-362a-4e12-bf12-942ce345fa15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:12.344195 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf5f79d-362a-4e12-bf12-942ce345fa15 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:12.361854 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 240/465] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:12.363296 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2183590-ee3d-4638-b33a-f4f5cc0d495e None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:12.363595 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2183590-ee3d-4638-b33a-f4f5cc0d495e None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:12.363874 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2183590-ee3d-4638-b33a-f4f5cc0d495e None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:12.365862 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 241/466] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:12.367284 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2183590-ee3d-4638-b33a-f4f5cc0d495e None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:12.421591 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:12.426455 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e97167-45f3-4a8a-b8a4-5f64687c2224 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:12.463058 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d1ad0c-8e09-45a3-ac27-5374ad820220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:12.463648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1ad0c-8e09-45a3-ac27-5374ad820220 None admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:12.463933 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1ad0c-8e09-45a3-ac27-5374ad820220 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:12.464208 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d1ad0c-8e09-45a3-ac27-5374ad820220 None admin] PATH_INFO: `/v3/users` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:12.464938 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1ad0c-8e09-45a3-ac27-5374ad820220 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:12.466383 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d1ad0c-8e09-45a3-ac27-5374ad820220 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:12.480593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2183590-ee3d-4638-b33a-f4f5cc0d495e None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:12.513821 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed609b9-8a57-40e4-b47e-fec846c05820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:12.515112 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed609b9-8a57-40e4-b47e-fec846c05820 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:12.515393 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed609b9-8a57-40e4-b47e-fec846c05820 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:12.515662 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed609b9-8a57-40e4-b47e-fec846c05820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:12.525914 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed609b9-8a57-40e4-b47e-fec846c05820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:12.527357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed609b9-8a57-40e4-b47e-fec846c05820 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:12.545231 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-aed609b9-8a57-40e4-b47e-fec846c05820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:12.545231 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:12.545231 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:12.545231 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:12.545231 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:12.545231 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:12.545231 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:12.545231 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:12.545231 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:12.545231 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:12.545231 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:12.545231 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:12.545231 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:12.545231 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:12.545231 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:12.546249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:12.546249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:12.546249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:12.546249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:12.546249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:12.546249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:12.546249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:12.546249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:12.546249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:12.546249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:12.546249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:12.546249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:12.546249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:12.546249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:12.546249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:12.546249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:12.546249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:12.547109 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:12.547109 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:12.547109 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:12.547109 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:12.547109 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 242/467] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:12.547426 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed609b9-8a57-40e4-b47e-fec846c05820 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:12.607750 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 226/468] 10.222.0.62 () {60 vars in 1132 bytes} [Wed May 25 15:39:12 2022] POST /identity/v3/users => generated 246 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:39:12.609536 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05b38e-f549-4b67-84ca-73316264e380 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:12.609827 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05b38e-f549-4b67-84ca-73316264e380 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:12.610106 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da05b38e-f549-4b67-84ca-73316264e380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:12.627714 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-da05b38e-f549-4b67-84ca-73316264e380 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:12.629076 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-da05b38e-f549-4b67-84ca-73316264e380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:12.662383 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:12.665493 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:12.669576 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed609b9-8a57-40e4-b47e-fec846c05820 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:12.710703 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 227/469] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:39:12.711372 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2a0fe-8f09-420c-867a-76c909aa0d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:12.712218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2a0fe-8f09-420c-867a-76c909aa0d03 None admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:12.712592 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2a0fe-8f09-420c-867a-76c909aa0d03 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:12.712877 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db2a0fe-8f09-420c-867a-76c909aa0d03 None admin] PATH_INFO: `/v3/users` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:12.713561 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05b38e-f549-4b67-84ca-73316264e380 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:12.713677 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2a0fe-8f09-420c-867a-76c909aa0d03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:12.715098 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db2a0fe-8f09-420c-867a-76c909aa0d03 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:12.835403 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da05b38e-f549-4b67-84ca-73316264e380 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:12.835980 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 243/470] 10.222.0.62 () {60 vars in 1132 bytes} [Wed May 25 15:39:12 2022] POST /identity/v3/users => generated 248 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:39:12.836848 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2a0fe-8f09-420c-867a-76c909aa0d03 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:12.904641 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd123cb3-088c-40ea-911b-003542f39330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:12.906493 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd123cb3-088c-40ea-911b-003542f39330 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:12.906986 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd123cb3-088c-40ea-911b-003542f39330 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:12.907424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd123cb3-088c-40ea-911b-003542f39330 None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:12.908660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd123cb3-088c-40ea-911b-003542f39330 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:12.909125 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd123cb3-088c-40ea-911b-003542f39330 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:12.911348 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd123cb3-088c-40ea-911b-003542f39330 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:12.932033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 228/471] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:12.940639 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd123cb3-088c-40ea-911b-003542f39330 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:12.987179 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:12.987584 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db2a0fe-8f09-420c-867a-76c909aa0d03 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:13.033508 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f662cf-021a-42ae-a2af-c98ade3687f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:13.034331 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f662cf-021a-42ae-a2af-c98ade3687f0 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:13.034616 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f662cf-021a-42ae-a2af-c98ade3687f0 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:13.034892 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f662cf-021a-42ae-a2af-c98ade3687f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:13.053660 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f662cf-021a-42ae-a2af-c98ade3687f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:13.056092 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f662cf-021a-42ae-a2af-c98ade3687f0 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:13.080269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-f8f662cf-021a-42ae-a2af-c98ade3687f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:13.080269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:13.080269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:13.080269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:13.080269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:13.080269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:13.080269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:13.080269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:13.080269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:13.080269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:13.080269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:13.080269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:13.080269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:13.080269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:13.080269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:13.081263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:13.081263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:13.081263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:13.081263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:13.081263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:13.081263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:13.081263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:13.081263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:13.081263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:13.081263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:13.081263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:13.081263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:13.081263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:13.081263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:13.081263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:13.081263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:13.081263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:13.082096 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:13.082096 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:13.082096 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:13.082096 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:13.084269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 244/472] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:13.091018 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd123cb3-088c-40ea-911b-003542f39330 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:13.092036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f662cf-021a-42ae-a2af-c98ade3687f0 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:13.105809 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:13.145133 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05f00b-a705-4a85-9000-36e9912111d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:13.146156 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05f00b-a705-4a85-9000-36e9912111d6 None admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:13.146156 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05f00b-a705-4a85-9000-36e9912111d6 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:13.146434 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e05f00b-a705-4a85-9000-36e9912111d6 None admin] PATH_INFO: `/v3/users` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:13.147182 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05f00b-a705-4a85-9000-36e9912111d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:13.149915 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e05f00b-a705-4a85-9000-36e9912111d6 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:13.223917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f662cf-021a-42ae-a2af-c98ade3687f0 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:13.260551 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb7f601-0929-40a5-b251-698a6df694c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:13.261147 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7f601-0929-40a5-b251-698a6df694c8 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:13.261436 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7f601-0929-40a5-b251-698a6df694c8 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:13.261717 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb7f601-0929-40a5-b251-698a6df694c8 None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:13.262449 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7f601-0929-40a5-b251-698a6df694c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:13.262761 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7f601-0929-40a5-b251-698a6df694c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:13.264262 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb7f601-0929-40a5-b251-698a6df694c8 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:13.282593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 245/473] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:13.282793 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 229/474] 10.222.0.62 () {60 vars in 1132 bytes} [Wed May 25 15:39:12 2022] POST /identity/v3/users => generated 248 bytes in 343 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:39:13.289587 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05f00b-a705-4a85-9000-36e9912111d6 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:13.399908 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:13.423731 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e05f00b-a705-4a85-9000-36e9912111d6 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:13.470156 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104b32de-245f-4d65-b6ff-21b1300d58a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:13.471054 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b32de-245f-4d65-b6ff-21b1300d58a5 None admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:13.471346 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b32de-245f-4d65-b6ff-21b1300d58a5 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:13.471623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104b32de-245f-4d65-b6ff-21b1300d58a5 None admin] PATH_INFO: `/v3/users` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:13.472344 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b32de-245f-4d65-b6ff-21b1300d58a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:13.473969 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104b32de-245f-4d65-b6ff-21b1300d58a5 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:13.563223 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 230/475] 10.222.0.62 () {60 vars in 1132 bytes} [Wed May 25 15:39:13 2022] POST /identity/v3/users => generated 249 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:39:15.144821 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aa2ec-b7f6-4e04-bf24-e9802aad8d95 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:15.145338 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aa2ec-b7f6-4e04-bf24-e9802aad8d95 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:15.145439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aa2ec-b7f6-4e04-bf24-e9802aad8d95 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:15.147111 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 246/476] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:15.153095 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ccb54-ff8d-4426-9723-cec029d345a3 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:15.153641 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ccb54-ff8d-4426-9723-cec029d345a3 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:15.153641 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13ccb54-ff8d-4426-9723-cec029d345a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:15.173443 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-d13ccb54-ff8d-4426-9723-cec029d345a3 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:15.174699 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-d13ccb54-ff8d-4426-9723-cec029d345a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:15.252532 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 231/477] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:39:15.274852 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aa2ec-b7f6-4e04-bf24-e9802aad8d95 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:15.347338 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:15.364217 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc69ca-199f-4acf-8042-cd9ad76878d1 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:15.368340 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc69ca-199f-4acf-8042-cd9ad76878d1 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:15.368340 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc69ca-199f-4acf-8042-cd9ad76878d1 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:15.368340 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 232/478] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:15.374897 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fa921-3aad-4989-ad07-7f9361501eca None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:15.375645 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fa921-3aad-4989-ad07-7f9361501eca None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:15.376144 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fa921-3aad-4989-ad07-7f9361501eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:15.395275 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-bf0fa921-3aad-4989-ad07-7f9361501eca None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:15.396505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aa2ec-b7f6-4e04-bf24-e9802aad8d95 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:15.397226 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-bf0fa921-3aad-4989-ad07-7f9361501eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:15.445569 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe6eea-7fee-4571-a216-4398b8f03aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:15.446421 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe6eea-7fee-4571-a216-4398b8f03aae None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:15.454330 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe6eea-7fee-4571-a216-4398b8f03aae None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:15.454330 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbe6eea-7fee-4571-a216-4398b8f03aae None admin] PATH_INFO: `/v3/roles/service` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:15.463887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbe6eea-7fee-4571-a216-4398b8f03aae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:15.472753 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:15.475886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-6cbe6eea-7fee-4571-a216-4398b8f03aae None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:15.475886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:15.475886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:15.475886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:15.475886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:15.475886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:15.475886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:15.475886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:15.475886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:15.475886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:15.475886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:15.475886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:15.475886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:15.475886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:15.475886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:15.475886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:15.476866 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:15.476866 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:15.476866 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:15.476866 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:15.476866 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:15.476866 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:15.476866 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:15.476866 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:15.476866 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:15.476866 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:15.476866 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:15.476866 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:15.476866 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:15.476866 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:15.476866 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:15.476866 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:15.477719 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:15.477719 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:15.477719 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:15.477719 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:15.477719 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:15.477719 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:15.477719 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:15.477719 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:15.477719 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:15.477719 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:15.477719 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:15.477719 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:15.480495 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 247/479] 10.222.0.62 () {56 vars in 1102 bytes} [Wed May 25 15:39:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:15.484453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe6eea-7fee-4571-a216-4398b8f03aae None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:15.489556 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 233/480] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:39:15.516986 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fa921-3aad-4989-ad07-7f9361501eca None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:15.619676 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbe6eea-7fee-4571-a216-4398b8f03aae None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:15.645498 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fa921-3aad-4989-ad07-7f9361501eca None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:15.648925 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:15.659069 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836e563-699b-49f5-afad-e5169d82b223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:15.659822 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836e563-699b-49f5-afad-e5169d82b223 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:15.660032 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836e563-699b-49f5-afad-e5169d82b223 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:15.660317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9836e563-699b-49f5-afad-e5169d82b223 None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:15.661120 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836e563-699b-49f5-afad-e5169d82b223 None admin] RBAC: Adding query filter params (name=service) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:15.661429 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836e563-699b-49f5-afad-e5169d82b223 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:15.662856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9836e563-699b-49f5-afad-e5169d82b223 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:15.675088 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 248/481] 10.222.0.62 () {56 vars in 1103 bytes} [Wed May 25 15:39:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:15.681360 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836e563-699b-49f5-afad-e5169d82b223 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:15.691392 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741f700-c2d8-4111-ae8d-0f94f181e07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:15.692268 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741f700-c2d8-4111-ae8d-0f94f181e07e None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:15.692618 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741f700-c2d8-4111-ae8d-0f94f181e07e None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:15.692897 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6741f700-c2d8-4111-ae8d-0f94f181e07e None admin] PATH_INFO: `/v3/roles/service` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:15.709265 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6741f700-c2d8-4111-ae8d-0f94f181e07e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:15.724110 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-6741f700-c2d8-4111-ae8d-0f94f181e07e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:15.724110 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:15.724110 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:15.724110 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:15.724110 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:15.724110 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:15.724110 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:15.724110 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:15.724110 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:15.724110 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:15.724110 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:15.724110 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:15.724110 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:15.724110 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:15.724110 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:15.724110 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:15.725099 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:15.725099 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:15.725099 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:15.725099 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:15.725099 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:15.725099 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:15.725099 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:15.725099 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:15.725099 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:15.725099 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:15.725099 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:15.725099 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:15.725099 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:15.725099 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:15.725099 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:15.725099 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:15.725892 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:15.725892 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:15.725892 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:15.725892 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:15.725892 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:15.725892 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:15.725892 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:15.725892 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:15.725892 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:15.725892 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:15.725892 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:15.725892 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:15.725892 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 234/482] 10.222.0.62 () {56 vars in 1102 bytes} [Wed May 25 15:39:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:39:15.732926 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741f700-c2d8-4111-ae8d-0f94f181e07e None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:15.802938 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:15.813298 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9836e563-699b-49f5-afad-e5169d82b223 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:15.849008 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6741f700-c2d8-4111-ae8d-0f94f181e07e None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:15.852109 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57505668-745b-4a9f-87f7-b5bb1df319ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:15.852939 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57505668-745b-4a9f-87f7-b5bb1df319ea None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:15.853225 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57505668-745b-4a9f-87f7-b5bb1df319ea None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:15.853497 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57505668-745b-4a9f-87f7-b5bb1df319ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:15.864473 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57505668-745b-4a9f-87f7-b5bb1df319ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:15.865951 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57505668-745b-4a9f-87f7-b5bb1df319ea None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:15.884751 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-57505668-745b-4a9f-87f7-b5bb1df319ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:15.884751 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:15.884751 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:15.884751 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:15.884751 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:15.884751 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:15.884751 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:15.884751 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:15.884751 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:15.884751 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:15.884751 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:15.884751 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:15.884751 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:15.884751 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:15.884751 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:15.885875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:15.885875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:15.885875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:15.885875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:15.885875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:15.885875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:15.885875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:15.885875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:15.885875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:15.885875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:15.885875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:15.885875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:15.885875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:15.885875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:15.885875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:15.885875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:15.885875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:15.886957 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:15.886957 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:15.886957 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:15.886957 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:15.892765 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 249/483] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:15.892765 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16696ef-9761-4a8d-b223-250c0e82d95e None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:15.892765 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16696ef-9761-4a8d-b223-250c0e82d95e None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:15.892765 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16696ef-9761-4a8d-b223-250c0e82d95e None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:15.892765 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 250/484] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:15.893922 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520acf3c-abc8-4813-ae88-a9d77f9af259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:15.894919 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520acf3c-abc8-4813-ae88-a9d77f9af259 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:15.895279 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520acf3c-abc8-4813-ae88-a9d77f9af259 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:15.895561 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16696ef-9761-4a8d-b223-250c0e82d95e None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:15.895683 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520acf3c-abc8-4813-ae88-a9d77f9af259 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:15.896469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520acf3c-abc8-4813-ae88-a9d77f9af259 None admin] RBAC: Adding query filter params (name=service) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:15.896786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520acf3c-abc8-4813-ae88-a9d77f9af259 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:15.898193 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520acf3c-abc8-4813-ae88-a9d77f9af259 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:15.907569 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 235/485] 10.222.0.62 () {56 vars in 1103 bytes} [Wed May 25 15:39:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:15.913148 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd344a20-086e-46bd-a56f-c6c8ba4b5279 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:15.913739 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd344a20-086e-46bd-a56f-c6c8ba4b5279 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:15.913739 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd344a20-086e-46bd-a56f-c6c8ba4b5279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:15.931583 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-dd344a20-086e-46bd-a56f-c6c8ba4b5279 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:15.932822 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-dd344a20-086e-46bd-a56f-c6c8ba4b5279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:15.944823 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:16.006917 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 236/486] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:39:16.008001 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd344a20-086e-46bd-a56f-c6c8ba4b5279 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:16.015825 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16696ef-9761-4a8d-b223-250c0e82d95e None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:16.059458 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e263d3e-cefa-4f63-8da7-5956b1a4044d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:16.060128 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e263d3e-cefa-4f63-8da7-5956b1a4044d None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:16.060435 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e263d3e-cefa-4f63-8da7-5956b1a4044d None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:16.067991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e263d3e-cefa-4f63-8da7-5956b1a4044d None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:16.067991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e263d3e-cefa-4f63-8da7-5956b1a4044d None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:16.067991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e263d3e-cefa-4f63-8da7-5956b1a4044d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:16.068263 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:16.068336 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e263d3e-cefa-4f63-8da7-5956b1a4044d None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:16.074630 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 251/487] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:16.076340 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc13103-bade-4031-b1a3-99d6e1cbd6a2 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:16.076663 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc13103-bade-4031-b1a3-99d6e1cbd6a2 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:16.076958 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc13103-bade-4031-b1a3-99d6e1cbd6a2 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:16.078493 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 252/488] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:16.079198 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc13103-bade-4031-b1a3-99d6e1cbd6a2 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:16.119957 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd344a20-086e-46bd-a56f-c6c8ba4b5279 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:16.156648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63980928-2bfe-4654-b2c6-1f5ea45647a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:16.157518 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63980928-2bfe-4654-b2c6-1f5ea45647a7 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:16.157826 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63980928-2bfe-4654-b2c6-1f5ea45647a7 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:16.158078 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63980928-2bfe-4654-b2c6-1f5ea45647a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:16.169554 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63980928-2bfe-4654-b2c6-1f5ea45647a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:16.171725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63980928-2bfe-4654-b2c6-1f5ea45647a7 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:16.183642 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:16.187975 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc13103-bade-4031-b1a3-99d6e1cbd6a2 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:16.189665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-63980928-2bfe-4654-b2c6-1f5ea45647a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:16.189665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:16.189665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:16.189665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:16.189665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:16.189665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:16.189665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:16.189665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:16.189665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:16.189665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:16.189665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:16.189665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:16.189665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:16.189665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:16.189665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:16.190642 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:16.190642 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:16.190642 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:16.190642 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:16.190642 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:16.190642 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:16.190642 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:16.190642 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:16.190642 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:16.190642 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:16.190642 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:16.190642 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:16.190642 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:16.190642 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:16.190642 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:16.190642 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:16.190642 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:16.191641 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:16.191641 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:16.191641 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:16.191641 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:16.191641 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 237/489] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:16.192924 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63980928-2bfe-4654-b2c6-1f5ea45647a7 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:16.227042 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7765b69b-a74c-48d9-8017-200ee731a327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:16.228017 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765b69b-a74c-48d9-8017-200ee731a327 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:16.228279 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765b69b-a74c-48d9-8017-200ee731a327 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:16.228588 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7765b69b-a74c-48d9-8017-200ee731a327 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:16.239340 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7765b69b-a74c-48d9-8017-200ee731a327 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:16.247380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-7765b69b-a74c-48d9-8017-200ee731a327 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:16.247380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:16.247380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:16.247380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:16.247380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:16.247380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:16.247380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:16.247380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:16.247380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:16.247380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:16.247380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:16.247380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:16.247380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:16.247380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:16.247380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:16.247380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:16.248541 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:16.248541 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:16.248541 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:16.248541 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:16.248541 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:16.248541 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:16.248541 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:16.248541 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:16.248541 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:16.248541 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:16.248541 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:16.248541 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:16.248541 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:16.248541 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:16.248541 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:16.248541 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:16.249441 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:16.249441 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:16.249441 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:16.249441 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:16.249441 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:16.249441 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:16.249441 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:16.249441 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:16.249441 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:16.249441 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:16.249441 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:16.249441 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:16.249441 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 253/490] 10.222.0.62 () {56 vars in 1102 bytes} [Wed May 25 15:39:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:16.251765 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232b9e7-6cf9-4f8b-b354-3a48f66b33cb None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:16.252099 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232b9e7-6cf9-4f8b-b354-3a48f66b33cb None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:16.252377 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232b9e7-6cf9-4f8b-b354-3a48f66b33cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:16.269928 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-8232b9e7-6cf9-4f8b-b354-3a48f66b33cb None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:16.271128 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-8232b9e7-6cf9-4f8b-b354-3a48f66b33cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:16.297284 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:16.300312 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63980928-2bfe-4654-b2c6-1f5ea45647a7 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:16.336038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cb41e-e781-46ae-80dd-29b3b779d22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:16.336900 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cb41e-e781-46ae-80dd-29b3b779d22c None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:16.337196 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cb41e-e781-46ae-80dd-29b3b779d22c None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:16.337465 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199cb41e-e781-46ae-80dd-29b3b779d22c None admin] PATH_INFO: `/v3/users/nova` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:16.341919 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 254/491] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:39:16.343155 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232b9e7-6cf9-4f8b-b354-3a48f66b33cb None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:16.345557 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199cb41e-e781-46ae-80dd-29b3b779d22c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:16.347028 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199cb41e-e781-46ae-80dd-29b3b779d22c None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:16.363804 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-199cb41e-e781-46ae-80dd-29b3b779d22c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 15:39:16.363804 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:16.363804 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:16.363804 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:16.363804 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:16.363804 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:16.363804 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:16.363804 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:16.363804 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:16.363804 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:16.363804 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:16.363804 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:16.363804 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:39:16.363804 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:39:16.363804 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:39:16.363804 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:39:16.368710 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:16.368710 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:16.368710 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:39:16.368710 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:16.368710 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:39:16.368710 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:16.368710 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:16.368710 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:16.368710 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:16.368710 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:16.368710 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:16.368710 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:16.368710 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:16.368710 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:16.368710 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:16.368710 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:16.368710 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:16.368710 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:16.369622 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:16.369622 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:16.369622 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:39:16.369622 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:39:16.369622 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:39:16.369622 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:39:16.369622 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:39:16.369622 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:39:16.369622 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 15:39:16.369622 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:16.369622 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 238/492] 10.222.0.62 () {56 vars in 1093 bytes} [Wed May 25 15:39:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:16.369622 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cb41e-e781-46ae-80dd-29b3b779d22c None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:16.448528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:16.459409 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8232b9e7-6cf9-4f8b-b354-3a48f66b33cb None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:16.479890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199cb41e-e781-46ae-80dd-29b3b779d22c None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:16.496968 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363489ec-4fb5-44cb-92e5-f62ea11ee3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:16.497636 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363489ec-4fb5-44cb-92e5-f62ea11ee3d2 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:16.497916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363489ec-4fb5-44cb-92e5-f62ea11ee3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:16.498188 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363489ec-4fb5-44cb-92e5-f62ea11ee3d2 None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:16.499524 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363489ec-4fb5-44cb-92e5-f62ea11ee3d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:16.499829 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363489ec-4fb5-44cb-92e5-f62ea11ee3d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:16.501239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-363489ec-4fb5-44cb-92e5-f62ea11ee3d2 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:16.512530 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 255/493] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:16.513343 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363489ec-4fb5-44cb-92e5-f62ea11ee3d2 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:16.515183 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a2050-5785-4d92-8a26-41edf17d1b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:16.515915 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a2050-5785-4d92-8a26-41edf17d1b93 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:16.516253 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a2050-5785-4d92-8a26-41edf17d1b93 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:16.516501 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a2050-5785-4d92-8a26-41edf17d1b93 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:16.517991 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a2050-5785-4d92-8a26-41edf17d1b93 None admin] RBAC: Adding query filter params (name=service) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:16.517991 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a2050-5785-4d92-8a26-41edf17d1b93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:16.519025 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a2050-5785-4d92-8a26-41edf17d1b93 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:16.528146 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 239/494] 10.222.0.62 () {56 vars in 1103 bytes} [Wed May 25 15:39:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:16.528996 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a2050-5785-4d92-8a26-41edf17d1b93 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:16.554328 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:16.621902 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363489ec-4fb5-44cb-92e5-f62ea11ee3d2 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:16.632727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a2050-5785-4d92-8a26-41edf17d1b93 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:16.657332 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda1ba0-e859-4a59-8631-4111fd48561b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:16.658126 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda1ba0-e859-4a59-8631-4111fd48561b None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:16.658406 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda1ba0-e859-4a59-8631-4111fd48561b None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:16.658677 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fda1ba0-e859-4a59-8631-4111fd48561b None admin] PATH_INFO: `/v3/roles/service` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:16.667418 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc073df-de53-4b84-a850-b7cb88664cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:16.668096 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc073df-de53-4b84-a850-b7cb88664cfe None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:16.668478 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc073df-de53-4b84-a850-b7cb88664cfe None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:16.668616 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fda1ba0-e859-4a59-8631-4111fd48561b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:16.668762 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc073df-de53-4b84-a850-b7cb88664cfe None admin] PATH_INFO: `/v3/users` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:16.669603 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc073df-de53-4b84-a850-b7cb88664cfe None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:16.669916 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc073df-de53-4b84-a850-b7cb88664cfe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:16.672002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc073df-de53-4b84-a850-b7cb88664cfe None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:16.676862 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-1fda1ba0-e859-4a59-8631-4111fd48561b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:16.676862 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:16.676862 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:16.676862 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:16.676862 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:16.676862 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:16.676862 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:16.676862 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:16.676862 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:16.676862 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:16.676862 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:16.676862 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:16.676862 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:16.676862 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:16.676862 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:16.676862 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:16.677940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:16.677940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:16.677940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:16.677940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:16.677940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:16.677940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:16.677940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:16.677940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:16.677940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:16.677940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:16.677940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:16.677940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:16.677940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:16.677940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:16.677940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:16.677940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:16.678788 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:16.678788 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:16.678788 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:16.678788 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:16.678788 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:16.678788 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:16.678788 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:16.678788 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:16.678788 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:16.678788 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:16.678788 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:16.678788 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:16.678788 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 256/495] 10.222.0.62 () {56 vars in 1102 bytes} [Wed May 25 15:39:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:16.679492 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda1ba0-e859-4a59-8631-4111fd48561b None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:16.694886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:16.709905 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 240/496] 10.222.0.62 () {56 vars in 1133 bytes} [Wed May 25 15:39:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:16.710921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc073df-de53-4b84-a850-b7cb88664cfe None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:16.784209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fda1ba0-e859-4a59-8631-4111fd48561b None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:16.796915 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:16.816404 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc073df-de53-4b84-a850-b7cb88664cfe None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:16.819397 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b10493-f511-4d6e-b6a3-bdb416b62ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:16.820196 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b10493-f511-4d6e-b6a3-bdb416b62ef1 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:16.820512 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b10493-f511-4d6e-b6a3-bdb416b62ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:16.820793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b10493-f511-4d6e-b6a3-bdb416b62ef1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:16.828631 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b10493-f511-4d6e-b6a3-bdb416b62ef1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:16.830161 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b10493-f511-4d6e-b6a3-bdb416b62ef1 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:16.846283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-61b10493-f511-4d6e-b6a3-bdb416b62ef1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 15:39:16.846283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:16.846283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:16.846283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:16.846283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:16.846283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:16.846283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:16.846283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:16.846283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:16.846283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:16.846283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:16.846283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:16.846283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:39:16.846283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:39:16.846283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:39:16.846283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:39:16.847328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:16.847328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:16.847328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:39:16.847328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:16.847328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:39:16.847328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:16.847328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:16.847328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:16.847328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:16.847328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:16.847328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:16.847328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:16.847328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:16.847328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:16.847328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:16.847328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:16.847328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:16.847328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:16.848336 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:16.848336 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:16.848336 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:39:16.848336 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:39:16.848336 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:39:16.848336 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:39:16.848336 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:39:16.848336 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:39:16.848336 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 15:39:16.848336 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:16.848336 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 257/497] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:39:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:16.848336 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b10493-f511-4d6e-b6a3-bdb416b62ef1 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:16.854193 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d226e26-0483-42cf-829f-c7711a2f6439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:16.854495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d226e26-0483-42cf-829f-c7711a2f6439 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:16.854783 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d226e26-0483-42cf-829f-c7711a2f6439 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:16.855056 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d226e26-0483-42cf-829f-c7711a2f6439 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:16.867113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d226e26-0483-42cf-829f-c7711a2f6439 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:16.868610 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d226e26-0483-42cf-829f-c7711a2f6439 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:16.886777 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-9d226e26-0483-42cf-829f-c7711a2f6439 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:16.886777 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:16.886777 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:16.886777 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:16.886777 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:16.886777 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:16.886777 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:16.886777 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:16.886777 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:16.886777 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:16.886777 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:16.886777 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:16.886777 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:16.886777 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:16.886777 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:16.887797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:16.887797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:16.887797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:16.887797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:16.887797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:16.887797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:16.887797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:16.887797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:16.887797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:16.887797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:16.887797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:16.887797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:16.887797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:16.887797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:16.887797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:16.887797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:16.887797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:16.900489 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:16.900489 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:16.900489 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:16.900489 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:16.900489 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 241/498] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:16.900489 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d226e26-0483-42cf-829f-c7711a2f6439 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:16.919738 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:16.953313 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b10493-f511-4d6e-b6a3-bdb416b62ef1 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:16.991163 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10f379-c0e3-4e9b-8d31-9b2f4ed33f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:16.991568 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d226e26-0483-42cf-829f-c7711a2f6439 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:16.991751 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10f379-c0e3-4e9b-8d31-9b2f4ed33f77 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:16.992034 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10f379-c0e3-4e9b-8d31-9b2f4ed33f77 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:16.992309 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10f379-c0e3-4e9b-8d31-9b2f4ed33f77 None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:16.993097 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10f379-c0e3-4e9b-8d31-9b2f4ed33f77 None admin] RBAC: Adding query filter params (name=service) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:16.993403 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10f379-c0e3-4e9b-8d31-9b2f4ed33f77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:16.994882 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10f379-c0e3-4e9b-8d31-9b2f4ed33f77 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:17.002921 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 258/499] 10.222.0.62 () {56 vars in 1103 bytes} [Wed May 25 15:39:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:17.003725 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10f379-c0e3-4e9b-8d31-9b2f4ed33f77 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:17.029423 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:17.035519 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af02ca-3b6f-4ada-a758-56402b71ac5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:17.036164 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af02ca-3b6f-4ada-a758-56402b71ac5f None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:17.036474 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af02ca-3b6f-4ada-a758-56402b71ac5f None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:17.036751 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af02ca-3b6f-4ada-a758-56402b71ac5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:17.107877 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10f379-c0e3-4e9b-8d31-9b2f4ed33f77 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:17.108738 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af02ca-3b6f-4ada-a758-56402b71ac5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:17.110217 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af02ca-3b6f-4ada-a758-56402b71ac5f None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:17.140938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:17.146654 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85feae13-7cde-4503-bb92-5d21a635e717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:17.153150 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85feae13-7cde-4503-bb92-5d21a635e717 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:17.153150 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85feae13-7cde-4503-bb92-5d21a635e717 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:17.153150 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85feae13-7cde-4503-bb92-5d21a635e717 None admin] PATH_INFO: `/v3/users` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:17.153150 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85feae13-7cde-4503-bb92-5d21a635e717 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:17.153150 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85feae13-7cde-4503-bb92-5d21a635e717 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:17.153150 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85feae13-7cde-4503-bb92-5d21a635e717 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:17.188823 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 259/500] 10.222.0.62 () {56 vars in 1137 bytes} [Wed May 25 15:39:17 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:17.189679 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85feae13-7cde-4503-bb92-5d21a635e717 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:17.216987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 242/501] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:39:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:39:17.217939 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af02ca-3b6f-4ada-a758-56402b71ac5f None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:17.248075 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:17.294643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85feae13-7cde-4503-bb92-5d21a635e717 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:17.318094 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af02ca-3b6f-4ada-a758-56402b71ac5f None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:17.329143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93988f0-7f7f-4f98-baf9-b28db17edff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:17.329807 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93988f0-7f7f-4f98-baf9-b28db17edff8 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:17.330087 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93988f0-7f7f-4f98-baf9-b28db17edff8 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:17.330377 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93988f0-7f7f-4f98-baf9-b28db17edff8 None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:17.331094 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93988f0-7f7f-4f98-baf9-b28db17edff8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:17.331399 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93988f0-7f7f-4f98-baf9-b28db17edff8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:17.332804 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93988f0-7f7f-4f98-baf9-b28db17edff8 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:17.344315 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 260/502] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:17.344315 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93988f0-7f7f-4f98-baf9-b28db17edff8 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:17.353238 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8314f49-48fa-4f53-b86c-ef1b8b57e7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:17.354037 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8314f49-48fa-4f53-b86c-ef1b8b57e7f2 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:17.354321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8314f49-48fa-4f53-b86c-ef1b8b57e7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:17.354596 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8314f49-48fa-4f53-b86c-ef1b8b57e7f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:17.364991 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8314f49-48fa-4f53-b86c-ef1b8b57e7f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:17.366628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8314f49-48fa-4f53-b86c-ef1b8b57e7f2 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:17.384390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-c8314f49-48fa-4f53-b86c-ef1b8b57e7f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:17.384390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:17.384390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:17.384390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:17.384390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:17.384390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:17.384390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:17.384390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:17.384390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:17.384390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:17.384390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:17.384390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:17.384390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:17.384390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:17.384390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:17.385441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:17.385441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:17.385441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:17.385441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:17.385441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:17.385441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:17.385441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:17.385441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:17.385441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:17.385441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:17.385441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:17.385441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:17.385441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:17.385441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:17.385441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:17.385441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:17.385441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:17.386356 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:17.386356 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:17.386356 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:17.386356 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:17.390907 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 243/503] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:17.391762 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8314f49-48fa-4f53-b86c-ef1b8b57e7f2 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:17.399265 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:17.449520 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93988f0-7f7f-4f98-baf9-b28db17edff8 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:17.478022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:17.486026 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f1229-0098-4e49-bfd5-90b03ec6fe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:17.486715 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f1229-0098-4e49-bfd5-90b03ec6fe50 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:17.487022 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f1229-0098-4e49-bfd5-90b03ec6fe50 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:17.487292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371f1229-0098-4e49-bfd5-90b03ec6fe50 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:17.493790 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8314f49-48fa-4f53-b86c-ef1b8b57e7f2 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:17.531898 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02401c2d-abf5-4083-a58a-be01b6ce6a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:17.532632 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02401c2d-abf5-4083-a58a-be01b6ce6a41 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:17.532918 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02401c2d-abf5-4083-a58a-be01b6ce6a41 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:17.533197 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02401c2d-abf5-4083-a58a-be01b6ce6a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:17.543278 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02401c2d-abf5-4083-a58a-be01b6ce6a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:17.544810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02401c2d-abf5-4083-a58a-be01b6ce6a41 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:17.557194 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f1229-0098-4e49-bfd5-90b03ec6fe50 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:17.558639 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371f1229-0098-4e49-bfd5-90b03ec6fe50 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:17.563035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-02401c2d-abf5-4083-a58a-be01b6ce6a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:17.563035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:17.563035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:17.563035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:17.563035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:17.563035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:17.563035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:17.563035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:17.563035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:17.563035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:17.563035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:17.563035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:17.563035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:17.563035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:17.563035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:17.564029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:17.564029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:17.564029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:17.564029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:17.564029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:17.564029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:17.564029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:17.564029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:17.564029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:17.564029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:17.564029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:17.564029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:17.564029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:17.564029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:17.564029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:17.564029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:17.564029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:17.565255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:17.565255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:17.565255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:17.565255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:17.565255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 244/504] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:17.565255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02401c2d-abf5-4083-a58a-be01b6ce6a41 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:17.610985 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:17.666324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02401c2d-abf5-4083-a58a-be01b6ce6a41 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:17.666526 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 261/505] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:39:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:39:17.667285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f1229-0098-4e49-bfd5-90b03ec6fe50 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:17.705512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f9a96-07e0-4e35-9c00-d9982b801ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:17.706309 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f9a96-07e0-4e35-9c00-d9982b801ae8 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:17.706597 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f9a96-07e0-4e35-9c00-d9982b801ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:17.706875 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9f9a96-07e0-4e35-9c00-d9982b801ae8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:17.709654 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:17.714379 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f9a96-07e0-4e35-9c00-d9982b801ae8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:17.715845 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9f9a96-07e0-4e35-9c00-d9982b801ae8 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:17.730512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-4d9f9a96-07e0-4e35-9c00-d9982b801ae8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:39:17.730512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:17.730512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:17.730512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:17.730512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:17.730512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:17.730512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:17.730512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:17.730512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:17.730512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:17.730512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:17.730512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:17.730512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:39:17.730512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:39:17.730512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:39:17.730512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:39:17.731424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:17.731424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:17.731424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:39:17.731424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:17.731424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:39:17.731424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:17.731424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:17.731424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:17.731424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:17.731424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:17.731424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:17.731424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:17.731424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:17.731424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:17.731424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:17.731424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:17.731424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:17.731424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:17.732346 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:17.732346 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:17.732346 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:39:17.732346 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:39:17.732346 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:39:17.732346 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:39:17.732346 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:39:17.732346 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:39:17.732346 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:39:17.732346 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:17.732346 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 245/506] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:39:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:17.732933 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f9a96-07e0-4e35-9c00-d9982b801ae8 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:17.777920 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371f1229-0098-4e49-bfd5-90b03ec6fe50 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:17.812839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b18e00-0d93-4c46-99eb-c501af1b3bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:17.813506 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b18e00-0d93-4c46-99eb-c501af1b3bb7 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:17.813791 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b18e00-0d93-4c46-99eb-c501af1b3bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:17.814064 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b18e00-0d93-4c46-99eb-c501af1b3bb7 None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:17.814775 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b18e00-0d93-4c46-99eb-c501af1b3bb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:17.815081 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b18e00-0d93-4c46-99eb-c501af1b3bb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:17.816491 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b18e00-0d93-4c46-99eb-c501af1b3bb7 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:17.827738 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 262/507] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:17.828570 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b18e00-0d93-4c46-99eb-c501af1b3bb7 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:17.835178 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9f9a96-07e0-4e35-9c00-d9982b801ae8 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:17.840748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:17.872458 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09eab7-7989-48f5-866a-98d714be05e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:17.873119 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09eab7-7989-48f5-866a-98d714be05e0 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:17.873401 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09eab7-7989-48f5-866a-98d714be05e0 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:17.873676 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09eab7-7989-48f5-866a-98d714be05e0 None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:17.874558 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09eab7-7989-48f5-866a-98d714be05e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:17.874907 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09eab7-7989-48f5-866a-98d714be05e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:17.876319 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e09eab7-7989-48f5-866a-98d714be05e0 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:17.888741 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 246/508] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:17.890451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09eab7-7989-48f5-866a-98d714be05e0 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:17.934276 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b18e00-0d93-4c46-99eb-c501af1b3bb7 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:17.947669 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:17.970377 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb0a6b-b0c4-44be-b637-5a947ec8ec4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:17.971173 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb0a6b-b0c4-44be-b637-5a947ec8ec4d None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:17.971456 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb0a6b-b0c4-44be-b637-5a947ec8ec4d None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:17.971728 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fb0a6b-b0c4-44be-b637-5a947ec8ec4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:17.982718 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb0a6b-b0c4-44be-b637-5a947ec8ec4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:17.984567 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fb0a6b-b0c4-44be-b637-5a947ec8ec4d None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:17.992872 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09eab7-7989-48f5-866a-98d714be05e0 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:18.002445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-a9fb0a6b-b0c4-44be-b637-5a947ec8ec4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:18.002445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:18.002445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:18.002445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:18.002445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:18.002445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:18.002445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:18.002445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:18.002445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:18.002445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:18.002445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:18.002445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:18.002445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:18.002445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:18.002445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:18.004115 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:18.004115 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:18.004115 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:18.004115 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:18.004115 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:18.004115 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:18.004115 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:18.004115 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:18.004115 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:18.004115 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:18.004115 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:18.004115 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:18.004115 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:18.004115 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:18.004115 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:18.004115 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:18.004115 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:18.005293 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:18.005293 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:18.005293 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:18.005293 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:18.005293 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 263/509] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:18.005293 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb0a6b-b0c4-44be-b637-5a947ec8ec4d None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:18.035102 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74463679-f4d0-4e89-a0ad-e4450b65093e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:18.035827 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74463679-f4d0-4e89-a0ad-e4450b65093e None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:18.036735 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74463679-f4d0-4e89-a0ad-e4450b65093e None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:18.036735 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74463679-f4d0-4e89-a0ad-e4450b65093e None admin] PATH_INFO: `/v3/users` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:18.037736 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74463679-f4d0-4e89-a0ad-e4450b65093e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:18.038051 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74463679-f4d0-4e89-a0ad-e4450b65093e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:18.039540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74463679-f4d0-4e89-a0ad-e4450b65093e None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:18.060187 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 247/510] 10.222.0.62 () {56 vars in 1137 bytes} [Wed May 25 15:39:17 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:18.061039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74463679-f4d0-4e89-a0ad-e4450b65093e None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:18.079662 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:18.118904 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fb0a6b-b0c4-44be-b637-5a947ec8ec4d None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:18.158262 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70bfeb-3844-4984-9f4a-d0c56cee15f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:18.159078 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70bfeb-3844-4984-9f4a-d0c56cee15f7 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:18.159368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70bfeb-3844-4984-9f4a-d0c56cee15f7 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:18.159641 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c70bfeb-3844-4984-9f4a-d0c56cee15f7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:18.167229 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70bfeb-3844-4984-9f4a-d0c56cee15f7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:18.167918 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74463679-f4d0-4e89-a0ad-e4450b65093e None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:18.168706 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c70bfeb-3844-4984-9f4a-d0c56cee15f7 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:18.182793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-4c70bfeb-3844-4984-9f4a-d0c56cee15f7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 15:39:18.182793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:18.182793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:18.182793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:18.182793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:18.182793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:18.182793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:18.182793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:18.182793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:18.182793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:18.182793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:18.182793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:18.182793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:39:18.182793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:39:18.182793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:39:18.182793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:39:18.183900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:18.183900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:18.183900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:39:18.183900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:18.183900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:39:18.183900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:18.183900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:18.183900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:18.183900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:18.183900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:18.183900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:18.183900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:18.183900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:18.183900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:18.183900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:18.183900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:18.183900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:18.183900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:18.185080 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:18.185080 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:18.185080 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:39:18.185080 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:39:18.185080 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:39:18.185080 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:39:18.185080 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:39:18.185080 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:39:18.185080 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 15:39:18.185080 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:18.186014 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:18.189554 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 264/511] 10.222.0.62 () {56 vars in 1102 bytes} [Wed May 25 15:39:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:18.190369 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70bfeb-3844-4984-9f4a-d0c56cee15f7 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:18.205589 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb548c-081b-4ae9-ab16-8b2363a05dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:18.206473 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb548c-081b-4ae9-ab16-8b2363a05dc3 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:18.206761 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb548c-081b-4ae9-ab16-8b2363a05dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:18.207038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5beb548c-081b-4ae9-ab16-8b2363a05dc3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:18.213838 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb548c-081b-4ae9-ab16-8b2363a05dc3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:18.215562 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5beb548c-081b-4ae9-ab16-8b2363a05dc3 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:18.231342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-5beb548c-081b-4ae9-ab16-8b2363a05dc3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:18.231342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:18.231342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:18.231342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:18.231342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:18.231342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:18.231342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:18.231342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:18.231342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:18.231342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:18.231342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:18.231342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:18.231342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:39:18.231342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:39:18.231342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:39:18.232704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:39:18.232704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:18.232704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:18.232704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:18.232704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:18.232704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:18.232704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:18.232704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:18.232704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:18.232704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:18.232704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:18.232704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:18.232704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:18.232704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:18.232704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:18.232704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:18.232704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:18.233591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:39:18.233591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:39:18.233591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:39:18.233591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:39:18.233591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:39:18.233591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:39:18.233591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:18.233591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:18.233591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 248/512] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:18.234260 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb548c-081b-4ae9-ab16-8b2363a05dc3 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:18.295879 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c70bfeb-3844-4984-9f4a-d0c56cee15f7 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:18.318915 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:18.333209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232070a-9990-4aff-b357-747afcc19a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:18.333209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232070a-9990-4aff-b357-747afcc19a41 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:18.333209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232070a-9990-4aff-b357-747afcc19a41 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:18.333209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232070a-9990-4aff-b357-747afcc19a41 None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:18.333629 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232070a-9990-4aff-b357-747afcc19a41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:18.333916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232070a-9990-4aff-b357-747afcc19a41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:18.335281 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232070a-9990-4aff-b357-747afcc19a41 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:18.338677 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5beb548c-081b-4ae9-ab16-8b2363a05dc3 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:18.347169 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 265/513] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:18.347979 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232070a-9990-4aff-b357-747afcc19a41 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:18.379293 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d764a53-b5e2-4bdc-aabd-58708ac249d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:18.379934 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d764a53-b5e2-4bdc-aabd-58708ac249d6 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:18.380214 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d764a53-b5e2-4bdc-aabd-58708ac249d6 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:18.380513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d764a53-b5e2-4bdc-aabd-58708ac249d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:18.424936 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:18.448372 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232070a-9990-4aff-b357-747afcc19a41 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:18.452688 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d764a53-b5e2-4bdc-aabd-58708ac249d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:18.454154 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d764a53-b5e2-4bdc-aabd-58708ac249d6 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:18.482615 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefc543-6f7b-41c5-b79f-77f5864d215a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:18.484079 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefc543-6f7b-41c5-b79f-77f5864d215a None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:18.484310 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefc543-6f7b-41c5-b79f-77f5864d215a None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:18.484613 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aefc543-6f7b-41c5-b79f-77f5864d215a None admin] PATH_INFO: `/v3/users` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:18.485445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefc543-6f7b-41c5-b79f-77f5864d215a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:18.485749 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefc543-6f7b-41c5-b79f-77f5864d215a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:18.487213 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aefc543-6f7b-41c5-b79f-77f5864d215a None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:18.504683 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 266/514] 10.222.0.62 () {56 vars in 1139 bytes} [Wed May 25 15:39:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:18.505493 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefc543-6f7b-41c5-b79f-77f5864d215a None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:18.546497 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:18.556812 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 249/515] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:39:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:39:18.561825 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d764a53-b5e2-4bdc-aabd-58708ac249d6 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:18.610217 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aefc543-6f7b-41c5-b79f-77f5864d215a None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:18.634230 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:18.645225 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b90f1-e115-4bcd-805e-43ee21403f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:18.647101 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b90f1-e115-4bcd-805e-43ee21403f04 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:18.647101 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b90f1-e115-4bcd-805e-43ee21403f04 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:18.647101 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5b90f1-e115-4bcd-805e-43ee21403f04 None admin] PATH_INFO: `/v3/projects` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:18.647348 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b90f1-e115-4bcd-805e-43ee21403f04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:18.647493 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b90f1-e115-4bcd-805e-43ee21403f04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:18.648978 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5b90f1-e115-4bcd-805e-43ee21403f04 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:18.659651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d764a53-b5e2-4bdc-aabd-58708ac249d6 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:18.666836 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 267/516] 10.222.0.62 () {56 vars in 1148 bytes} [Wed May 25 15:39:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:18.667683 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b90f1-e115-4bcd-805e-43ee21403f04 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:18.701969 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964d357-f017-4355-a78e-90e36e1a7fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:18.702758 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964d357-f017-4355-a78e-90e36e1a7fe8 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:18.703040 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964d357-f017-4355-a78e-90e36e1a7fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:18.703315 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3964d357-f017-4355-a78e-90e36e1a7fe8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:18.710064 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964d357-f017-4355-a78e-90e36e1a7fe8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:18.711505 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3964d357-f017-4355-a78e-90e36e1a7fe8 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:18.726053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-3964d357-f017-4355-a78e-90e36e1a7fe8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:18.726053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:18.726053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:18.726053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:18.726053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:18.726053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:18.726053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:18.726053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:18.726053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:18.726053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:18.726053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:18.726053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:18.726053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:39:18.726053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:39:18.726053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:39:18.726921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:39:18.726921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:18.726921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:18.726921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:18.726921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:18.726921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:18.726921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:18.726921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:18.726921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:18.726921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:18.726921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:18.726921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:18.726921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:18.726921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:18.726921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:18.726921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:18.726921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:18.727764 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:39:18.727764 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:39:18.727764 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:39:18.727764 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:39:18.727764 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:39:18.727764 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:39:18.727764 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:18.727764 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:18.727764 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 250/517] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:18.728216 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964d357-f017-4355-a78e-90e36e1a7fe8 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:18.775143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:18.778095 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5b90f1-e115-4bcd-805e-43ee21403f04 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:18.813240 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b3a96-80b6-442d-bd82-8a58cd03bb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:18.813905 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b3a96-80b6-442d-bd82-8a58cd03bb10 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:18.814578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b3a96-80b6-442d-bd82-8a58cd03bb10 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:18.815164 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91b3a96-80b6-442d-bd82-8a58cd03bb10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:18.829142 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3964d357-f017-4355-a78e-90e36e1a7fe8 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:18.863510 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fb6aa-259a-454d-8dd3-b4f286e74517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:18.864436 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fb6aa-259a-454d-8dd3-b4f286e74517 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:18.864725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fb6aa-259a-454d-8dd3-b4f286e74517 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:18.865000 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9fb6aa-259a-454d-8dd3-b4f286e74517 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:18.866913 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:18.876169 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fb6aa-259a-454d-8dd3-b4f286e74517 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:18.881665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9fb6aa-259a-454d-8dd3-b4f286e74517 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:18.882846 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b3a96-80b6-442d-bd82-8a58cd03bb10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:18.884320 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91b3a96-80b6-442d-bd82-8a58cd03bb10 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:18.895307 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-5d9fb6aa-259a-454d-8dd3-b4f286e74517 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:18.895307 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:18.895307 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:18.895307 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:18.895307 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:18.895307 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:18.895307 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:18.895307 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:18.895307 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:18.895307 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:18.895307 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:18.895307 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:18.895307 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:18.895307 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:18.895307 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:18.896334 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:18.896334 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:18.896334 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:18.896334 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:18.896334 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:18.896334 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:18.896334 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:18.896334 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:18.896334 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:18.896334 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:18.896334 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:18.896334 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:18.896334 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:18.896334 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:18.896334 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:18.896334 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:18.896334 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:18.897287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:18.897287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:18.897287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:18.897287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:18.900626 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 251/518] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:18.901590 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fb6aa-259a-454d-8dd3-b4f286e74517 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:18.984154 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:18.987895 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 268/519] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:39:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:39:18.988736 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b3a96-80b6-442d-bd82-8a58cd03bb10 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:19.006097 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9fb6aa-259a-454d-8dd3-b4f286e74517 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:19.094609 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91b3a96-80b6-442d-bd82-8a58cd03bb10 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:19.133883 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f4c7c-bf68-4719-bea4-f299b71c34e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:19.134346 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f4c7c-bf68-4719-bea4-f299b71c34e2 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:19.135171 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f4c7c-bf68-4719-bea4-f299b71c34e2 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:19.135455 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f4c7c-bf68-4719-bea4-f299b71c34e2 None admin] PATH_INFO: `/v3/projects` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:19.136242 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f4c7c-bf68-4719-bea4-f299b71c34e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:19.136936 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f4c7c-bf68-4719-bea4-f299b71c34e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:19.138886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f4c7c-bf68-4719-bea4-f299b71c34e2 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:19.151905 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 269/520] 10.222.0.62 () {56 vars in 1148 bytes} [Wed May 25 15:39:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:19.152754 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f4c7c-bf68-4719-bea4-f299b71c34e2 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:19.165157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949860d-0a79-42c2-82dd-b94bb3be5885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:19.165823 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949860d-0a79-42c2-82dd-b94bb3be5885 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:19.166110 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949860d-0a79-42c2-82dd-b94bb3be5885 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:19.166387 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9949860d-0a79-42c2-82dd-b94bb3be5885 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:19.167305 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949860d-0a79-42c2-82dd-b94bb3be5885 None admin] RBAC: Adding query filter params (role.id=d1d28f6c8cb34e9f8af7cda9d128a351, scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5, user.id=d9b8b255e35c4949ba8faeb79921f141) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:19.167618 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949860d-0a79-42c2-82dd-b94bb3be5885 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:19.169091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9949860d-0a79-42c2-82dd-b94bb3be5885 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:19.175706 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 252/521] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:39:18 2022] GET /identity/v3/role_assignments?user.id=d9b8b255e35c4949ba8faeb79921f141&scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5&role.id=d1d28f6c8cb34e9f8af7cda9d128a351 => generated 259 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:19.176588 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949860d-0a79-42c2-82dd-b94bb3be5885 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:19.234361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:19.237359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:19.284753 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f4c7c-bf68-4719-bea4-f299b71c34e2 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:19.293119 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9949860d-0a79-42c2-82dd-b94bb3be5885 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:19.325370 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbbf63-cee7-4079-b87c-4a879eaade77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:19.326052 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbbf63-cee7-4079-b87c-4a879eaade77 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:19.326377 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbbf63-cee7-4079-b87c-4a879eaade77 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:19.326659 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cbbf63-cee7-4079-b87c-4a879eaade77 None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:19.327928 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbbf63-cee7-4079-b87c-4a879eaade77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:19.328347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbbf63-cee7-4079-b87c-4a879eaade77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:19.329941 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cbbf63-cee7-4079-b87c-4a879eaade77 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:19.332886 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9ee2f-eb7c-4646-9248-d2964066a77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:19.333699 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9ee2f-eb7c-4646-9248-d2964066a77a None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:19.333980 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9ee2f-eb7c-4646-9248-d2964066a77a None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:19.334280 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9ee2f-eb7c-4646-9248-d2964066a77a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:19.344758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 270/522] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:19.346075 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbbf63-cee7-4079-b87c-4a879eaade77 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:19.352599 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9ee2f-eb7c-4646-9248-d2964066a77a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:19.354155 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9ee2f-eb7c-4646-9248-d2964066a77a None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:19.373397 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-c7d9ee2f-eb7c-4646-9248-d2964066a77a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:19.373397 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:19.373397 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:19.373397 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:19.373397 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:19.373397 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:19.373397 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:19.373397 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:19.373397 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:19.373397 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:19.373397 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:19.373397 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:19.373397 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:19.373397 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:19.373397 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:19.374345 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:19.374345 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:19.374345 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:19.374345 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:19.374345 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:19.374345 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:19.374345 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:19.374345 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:19.374345 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:19.374345 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:19.374345 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:19.374345 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:19.374345 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:19.374345 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:19.374345 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:19.374345 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:19.374345 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:19.375181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:19.375181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:19.375181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:19.375181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:19.375408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 253/523] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:19.376030 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9ee2f-eb7c-4646-9248-d2964066a77a None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:19.472335 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cbbf63-cee7-4079-b87c-4a879eaade77 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:19.491183 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9ee2f-eb7c-4646-9248-d2964066a77a None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:19.493035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:19.497782 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:19.512290 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c01f17-32d0-4cae-ab3c-fe44f7e6ee74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:19.512984 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c01f17-32d0-4cae-ab3c-fe44f7e6ee74 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:19.513273 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c01f17-32d0-4cae-ab3c-fe44f7e6ee74 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:19.513557 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c01f17-32d0-4cae-ab3c-fe44f7e6ee74 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:19.514899 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c01f17-32d0-4cae-ab3c-fe44f7e6ee74 None admin] RBAC: Adding query filter params (role.id=d1d28f6c8cb34e9f8af7cda9d128a351, scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5, user.id=530c527ef42e4f949b15c74206baf99b) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:19.515212 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c01f17-32d0-4cae-ab3c-fe44f7e6ee74 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:19.516706 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c01f17-32d0-4cae-ab3c-fe44f7e6ee74 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:19.523463 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 271/524] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:39:19 2022] GET /identity/v3/role_assignments?user.id=530c527ef42e4f949b15c74206baf99b&scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5&role.id=d1d28f6c8cb34e9f8af7cda9d128a351 => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:19.524272 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c01f17-32d0-4cae-ab3c-fe44f7e6ee74 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:19.540887 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf95f5b-467f-4327-a5ba-ffffe1601ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:19.543734 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf95f5b-467f-4327-a5ba-ffffe1601ff9 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:19.543734 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf95f5b-467f-4327-a5ba-ffffe1601ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:19.543734 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf95f5b-467f-4327-a5ba-ffffe1601ff9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:19.554958 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf95f5b-467f-4327-a5ba-ffffe1601ff9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:19.557441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf95f5b-467f-4327-a5ba-ffffe1601ff9 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:19.578722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-4bf95f5b-467f-4327-a5ba-ffffe1601ff9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:19.578722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:19.578722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:19.578722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:19.578722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:19.578722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:19.578722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:19.578722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:19.578722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:19.578722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:19.578722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:19.578722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:19.578722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:39:19.578722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:39:19.578722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:39:19.586634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:39:19.586634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:19.586634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:19.586634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:19.586634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:19.586634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:19.586634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:19.586634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:19.586634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:19.586634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:19.586634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:19.586634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:19.586634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:19.586634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:19.586634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:19.586634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:19.586634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:19.587494 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:39:19.587494 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:39:19.587494 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:39:19.587494 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:39:19.587494 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:39:19.587494 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:39:19.587494 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:19.587494 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:19.587494 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 254/525] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:19.588574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf95f5b-467f-4327-a5ba-ffffe1601ff9 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:19.676142 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c01f17-32d0-4cae-ab3c-fe44f7e6ee74 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:19.728575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aad672-38da-4d29-b8b3-4c65b7db643b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:19.729870 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aad672-38da-4d29-b8b3-4c65b7db643b None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:19.730884 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aad672-38da-4d29-b8b3-4c65b7db643b None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:19.731318 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aad672-38da-4d29-b8b3-4c65b7db643b None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:19.732078 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aad672-38da-4d29-b8b3-4c65b7db643b None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:19.732401 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aad672-38da-4d29-b8b3-4c65b7db643b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:19.735124 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aad672-38da-4d29-b8b3-4c65b7db643b None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:19.738913 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf95f5b-467f-4327-a5ba-ffffe1601ff9 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:19.779552 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d95ba6-6403-4f99-ad97-8ea7c4ba92ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:19.781156 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d95ba6-6403-4f99-ad97-8ea7c4ba92ae None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:19.781743 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d95ba6-6403-4f99-ad97-8ea7c4ba92ae None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:19.782336 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d95ba6-6403-4f99-ad97-8ea7c4ba92ae None admin] PATH_INFO: `/v3/projects` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:19.783379 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d95ba6-6403-4f99-ad97-8ea7c4ba92ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:19.783920 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d95ba6-6403-4f99-ad97-8ea7c4ba92ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:19.785896 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d95ba6-6403-4f99-ad97-8ea7c4ba92ae None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:19.808537 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 255/526] 10.222.0.62 () {56 vars in 1148 bytes} [Wed May 25 15:39:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:19.818346 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d95ba6-6403-4f99-ad97-8ea7c4ba92ae None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:19.849451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:19.877020 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 272/527] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:19.882390 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aad672-38da-4d29-b8b3-4c65b7db643b None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:19.934457 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:19.943980 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d95ba6-6403-4f99-ad97-8ea7c4ba92ae None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:19.994349 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37a09c-b8d9-4f5a-925c-7d667a3466ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:19.994928 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37a09c-b8d9-4f5a-925c-7d667a3466ca None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:19.995212 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37a09c-b8d9-4f5a-925c-7d667a3466ca None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:19.995489 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f37a09c-b8d9-4f5a-925c-7d667a3466ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:19.996348 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37a09c-b8d9-4f5a-925c-7d667a3466ca None admin] RBAC: Adding query filter params (role.id=d1d28f6c8cb34e9f8af7cda9d128a351, scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5, user.id=45fabc3594f64571a0b381990b7974f8) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:19.996684 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37a09c-b8d9-4f5a-925c-7d667a3466ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:19.998176 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f37a09c-b8d9-4f5a-925c-7d667a3466ca None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:20.002600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aad672-38da-4d29-b8b3-4c65b7db643b None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:20.008814 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 256/528] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:39:19 2022] GET /identity/v3/role_assignments?user.id=45fabc3594f64571a0b381990b7974f8&scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5&role.id=d1d28f6c8cb34e9f8af7cda9d128a351 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:20.059659 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54819049-4629-4c13-abbe-eeeedc346802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:20.060568 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54819049-4629-4c13-abbe-eeeedc346802 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:20.060855 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54819049-4629-4c13-abbe-eeeedc346802 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:20.061172 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54819049-4629-4c13-abbe-eeeedc346802 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:20.069516 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54819049-4629-4c13-abbe-eeeedc346802 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:20.071003 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54819049-4629-4c13-abbe-eeeedc346802 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:20.089565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-54819049-4629-4c13-abbe-eeeedc346802 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:20.089565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:20.089565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:20.089565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:20.089565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:20.089565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:20.089565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:20.089565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:20.089565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:20.089565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:20.089565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:20.089565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:20.089565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:39:20.089565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:39:20.089565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:39:20.090474 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:39:20.090474 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:20.090474 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:20.090474 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:20.090474 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:20.090474 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:20.090474 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:20.090474 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:20.090474 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:20.090474 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:20.090474 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:20.090474 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:20.090474 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:20.090474 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:20.090474 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:20.090474 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:20.090474 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:20.091326 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:39:20.091326 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:39:20.091326 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:39:20.091326 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:39:20.091326 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:39:20.091326 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:39:20.091326 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:20.091326 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:20.091326 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 273/529] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:39:20.097423 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37a09c-b8d9-4f5a-925c-7d667a3466ca None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:20.204408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:20.221212 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f37a09c-b8d9-4f5a-925c-7d667a3466ca None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:20.261697 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee28ae-08a7-4d09-b5ea-d907becc8a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:20.262310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee28ae-08a7-4d09-b5ea-d907becc8a6f None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:20.262566 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee28ae-08a7-4d09-b5ea-d907becc8a6f None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:20.262841 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee28ae-08a7-4d09-b5ea-d907becc8a6f None admin] PATH_INFO: `/v3/projects` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:20.263634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee28ae-08a7-4d09-b5ea-d907becc8a6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:20.263943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee28ae-08a7-4d09-b5ea-d907becc8a6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:20.266067 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee28ae-08a7-4d09-b5ea-d907becc8a6f None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:20.279507 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 257/530] 10.222.0.62 () {56 vars in 1148 bytes} [Wed May 25 15:39:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:20.285403 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54819049-4629-4c13-abbe-eeeedc346802 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:20.411071 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54819049-4629-4c13-abbe-eeeedc346802 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:20.413665 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:20.446962 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4535d-ad9b-4ac4-9fc0-efc20d26cce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:20.448156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4535d-ad9b-4ac4-9fc0-efc20d26cce3 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:20.448835 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4535d-ad9b-4ac4-9fc0-efc20d26cce3 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:20.449115 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4535d-ad9b-4ac4-9fc0-efc20d26cce3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:20.449960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4535d-ad9b-4ac4-9fc0-efc20d26cce3 None admin] RBAC: Adding query filter params (role.id=d1d28f6c8cb34e9f8af7cda9d128a351, scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5, user.id=d1cb7a1be78c4b55b5ec991b99d47020) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:20.450274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4535d-ad9b-4ac4-9fc0-efc20d26cce3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:20.452380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4535d-ad9b-4ac4-9fc0-efc20d26cce3 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:20.459324 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 274/531] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:39:20 2022] GET /identity/v3/role_assignments?user.id=d1cb7a1be78c4b55b5ec991b99d47020&scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5&role.id=d1d28f6c8cb34e9f8af7cda9d128a351 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:21.524345 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a1887-7b11-4692-bffb-8ee95d1750ac None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:21.524886 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a1887-7b11-4692-bffb-8ee95d1750ac None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:21.524886 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2a1887-7b11-4692-bffb-8ee95d1750ac None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:21.526380 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 258/532] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:21.531894 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233690a-d826-4520-834b-066d40e41d44 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:21.532335 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233690a-d826-4520-834b-066d40e41d44 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:21.532556 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233690a-d826-4520-834b-066d40e41d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:21.550745 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-9233690a-d826-4520-834b-066d40e41d44 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:21.551948 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-9233690a-d826-4520-834b-066d40e41d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:21.626072 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 275/533] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:39:21.650111 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a1887-7b11-4692-bffb-8ee95d1750ac None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:21.775897 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2a1887-7b11-4692-bffb-8ee95d1750ac None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:21.815212 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a38e32-3572-4ce4-84dd-8ab678be86fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:21.816059 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a38e32-3572-4ce4-84dd-8ab678be86fd None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:21.816350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a38e32-3572-4ce4-84dd-8ab678be86fd None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:21.816654 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a38e32-3572-4ce4-84dd-8ab678be86fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:21.832445 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a38e32-3572-4ce4-84dd-8ab678be86fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:21.837475 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-d8a38e32-3572-4ce4-84dd-8ab678be86fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:21.837475 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:21.837475 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:21.837475 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:21.837475 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:21.837475 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:21.837475 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:21.837475 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:21.837475 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:21.837475 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:21.837475 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:21.837475 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:21.837475 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:21.837475 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:21.837475 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:21.837475 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:21.839276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:21.839276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:21.839276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:21.839276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:21.839276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:21.839276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:21.839276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:21.839276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:21.839276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:21.839276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:21.839276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:21.839276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:21.839276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:21.839276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:21.839276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:21.839276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:21.840064 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:21.840064 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:21.840064 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:21.840064 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:21.840064 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:21.840064 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:21.840064 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:21.840064 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:21.840064 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:21.840064 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:21.840064 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:21.840064 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:21.840064 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 259/534] 10.222.0.62 () {56 vars in 1102 bytes} [Wed May 25 15:39:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:21.847295 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233690a-d826-4520-834b-066d40e41d44 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:21.945051 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a0b2a-64f2-439c-95b0-409296af0535 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:21.945371 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a0b2a-64f2-439c-95b0-409296af0535 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:21.945685 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a0b2a-64f2-439c-95b0-409296af0535 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:21.947509 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 260/535] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:39:21.950215 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:21.954729 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233690a-d826-4520-834b-066d40e41d44 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:21.955112 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dea0f8-2f58-4bc8-ad3a-a8961522aa26 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:21.955624 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dea0f8-2f58-4bc8-ad3a-a8961522aa26 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:21.956102 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dea0f8-2f58-4bc8-ad3a-a8961522aa26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:21.969324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:21.975855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-f9dea0f8-2f58-4bc8-ad3a-a8961522aa26 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:21.977342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-f9dea0f8-2f58-4bc8-ad3a-a8961522aa26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:21.992365 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c78c6e-2d93-4acb-be29-68edc0301b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:21.993113 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c78c6e-2d93-4acb-be29-68edc0301b56 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:21.993402 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c78c6e-2d93-4acb-be29-68edc0301b56 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:21.993672 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c78c6e-2d93-4acb-be29-68edc0301b56 None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:21.994424 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c78c6e-2d93-4acb-be29-68edc0301b56 None admin] RBAC: Adding query filter params (name=service) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:21.994720 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c78c6e-2d93-4acb-be29-68edc0301b56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:21.996086 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c78c6e-2d93-4acb-be29-68edc0301b56 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:22.010811 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 276/536] 10.222.0.62 () {56 vars in 1103 bytes} [Wed May 25 15:39:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:22.011928 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c78c6e-2d93-4acb-be29-68edc0301b56 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:22.064680 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 261/537] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:39:22.085132 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dea0f8-2f58-4bc8-ad3a-a8961522aa26 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:22.128627 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c78c6e-2d93-4acb-be29-68edc0301b56 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:22.168017 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c8a74-1754-4813-9265-604ae8194c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:22.168920 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c8a74-1754-4813-9265-604ae8194c8e None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:22.169288 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c8a74-1754-4813-9265-604ae8194c8e None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:22.169463 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c8a74-1754-4813-9265-604ae8194c8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:22.181026 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c8a74-1754-4813-9265-604ae8194c8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:22.182487 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c8a74-1754-4813-9265-604ae8194c8e None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:22.201653 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-ab7c8a74-1754-4813-9265-604ae8194c8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:22.201653 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:22.201653 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:22.201653 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:22.201653 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:22.201653 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:22.201653 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:22.201653 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:22.201653 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:22.201653 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:22.201653 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:22.201653 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:22.201653 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:22.201653 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:22.201653 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:22.203357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:22.203357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:22.203357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:22.203357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:22.203357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:22.203357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:22.203357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:22.203357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:22.203357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:22.203357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:22.203357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:22.203357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:22.203357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:22.203357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:22.203357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:22.203357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:22.203357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:22.204261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:22.204261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:22.204261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:22.204261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:22.208456 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 277/538] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:22.210092 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c8a74-1754-4813-9265-604ae8194c8e None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:22.210377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dea0f8-2f58-4bc8-ad3a-a8961522aa26 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:22.227315 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:22.252449 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09afd2-c725-4abf-9992-5ec40217f582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:22.253618 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09afd2-c725-4abf-9992-5ec40217f582 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:22.254120 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09afd2-c725-4abf-9992-5ec40217f582 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:22.254568 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb09afd2-c725-4abf-9992-5ec40217f582 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:22.257829 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:22.269458 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb09afd2-c725-4abf-9992-5ec40217f582 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:22.278289 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-fb09afd2-c725-4abf-9992-5ec40217f582 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:22.278289 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:22.278289 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:22.278289 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:22.278289 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:22.278289 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:22.278289 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:22.278289 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:22.278289 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:22.278289 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:22.278289 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:22.278289 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:22.278289 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:22.278289 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:22.278289 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:22.278289 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:22.279177 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:22.279177 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:22.279177 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:22.279177 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:22.279177 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:22.279177 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:22.279177 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:22.279177 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:22.279177 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:22.279177 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:22.279177 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:22.279177 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:22.279177 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:22.279177 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:22.279177 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:22.279177 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:22.280111 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:22.280111 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:22.280111 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:22.280111 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:22.280111 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:22.280111 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:22.280111 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:22.280111 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:22.280111 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:22.280111 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:22.280111 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:22.280111 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:22.286595 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 262/539] 10.222.0.62 () {56 vars in 1102 bytes} [Wed May 25 15:39:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:39:22.288789 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09afd2-c725-4abf-9992-5ec40217f582 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:22.320869 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c8a74-1754-4813-9265-604ae8194c8e None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:22.357315 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f372278-328a-43e2-a6cf-5e9569bb6f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:22.358174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f372278-328a-43e2-a6cf-5e9569bb6f22 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:22.358576 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f372278-328a-43e2-a6cf-5e9569bb6f22 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:22.358950 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f372278-328a-43e2-a6cf-5e9569bb6f22 None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:22.359888 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f372278-328a-43e2-a6cf-5e9569bb6f22 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:22.360173 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f372278-328a-43e2-a6cf-5e9569bb6f22 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:22.361796 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f372278-328a-43e2-a6cf-5e9569bb6f22 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:22.379443 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 278/540] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:22.380852 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f372278-328a-43e2-a6cf-5e9569bb6f22 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:22.406914 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb09afd2-c725-4abf-9992-5ec40217f582 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:22.445025 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3e4bf4-f199-4bed-87ed-0b431982b50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:22.445698 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e4bf4-f199-4bed-87ed-0b431982b50b None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:22.445985 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e4bf4-f199-4bed-87ed-0b431982b50b None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:22.446261 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e4bf4-f199-4bed-87ed-0b431982b50b None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:22.447004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e4bf4-f199-4bed-87ed-0b431982b50b None admin] RBAC: Adding query filter params (name=service) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:22.447307 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e4bf4-f199-4bed-87ed-0b431982b50b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:22.448708 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3e4bf4-f199-4bed-87ed-0b431982b50b None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:22.463928 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 263/541] 10.222.0.62 () {56 vars in 1103 bytes} [Wed May 25 15:39:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:22.463928 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645a0d0-8550-4e32-8d43-fb21c6c11097 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:22.463928 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645a0d0-8550-4e32-8d43-fb21c6c11097 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:22.463928 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5645a0d0-8550-4e32-8d43-fb21c6c11097 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:22.463928 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 264/542] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:22.465450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645a0d0-8550-4e32-8d43-fb21c6c11097 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:22.466767 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:22.499603 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f372278-328a-43e2-a6cf-5e9569bb6f22 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:22.534693 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:22.539444 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5499d97-eb9f-4e8f-bb76-0dddbef405ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:22.540337 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5499d97-eb9f-4e8f-bb76-0dddbef405ab None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:22.540660 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5499d97-eb9f-4e8f-bb76-0dddbef405ab None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:22.540953 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5499d97-eb9f-4e8f-bb76-0dddbef405ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:22.549877 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5499d97-eb9f-4e8f-bb76-0dddbef405ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:22.551390 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5499d97-eb9f-4e8f-bb76-0dddbef405ab None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:22.567395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-f5499d97-eb9f-4e8f-bb76-0dddbef405ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 15:39:22.567395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:22.567395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:22.567395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:22.567395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:22.567395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:22.567395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:22.567395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:22.567395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:22.567395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:22.567395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:22.567395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:22.567395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:39:22.567395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:39:22.567395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:39:22.567395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:39:22.568565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:22.568565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:22.568565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:39:22.568565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:22.568565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:39:22.568565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:22.568565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:22.568565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:22.568565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:22.568565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:22.568565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:22.568565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:22.568565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:22.568565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:22.568565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:22.568565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:22.568565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:22.568565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:22.569502 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:22.569502 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:22.569502 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:39:22.569502 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:39:22.569502 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:39:22.569502 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:39:22.569502 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:39:22.569502 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:39:22.569502 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 15:39:22.569502 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:22.573441 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 279/543] 10.222.0.62 () {56 vars in 1093 bytes} [Wed May 25 15:39:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:39:22.574667 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b2218-ea8e-4ffa-970a-ef9a76ebccb8 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:22.574956 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b2218-ea8e-4ffa-970a-ef9a76ebccb8 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:22.575230 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0b2218-ea8e-4ffa-970a-ef9a76ebccb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:22.581905 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5645a0d0-8550-4e32-8d43-fb21c6c11097 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:22.592262 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-6b0b2218-ea8e-4ffa-970a-ef9a76ebccb8 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:22.594008 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-6b0b2218-ea8e-4ffa-970a-ef9a76ebccb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:22.620106 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3549a7-e180-4df0-921c-c015622f4d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:22.621036 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3549a7-e180-4df0-921c-c015622f4d71 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:22.621429 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3549a7-e180-4df0-921c-c015622f4d71 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:22.621707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3549a7-e180-4df0-921c-c015622f4d71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:22.636373 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3549a7-e180-4df0-921c-c015622f4d71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:22.637911 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3549a7-e180-4df0-921c-c015622f4d71 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:22.664802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-9d3549a7-e180-4df0-921c-c015622f4d71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:22.664802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:22.664802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:22.664802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:22.664802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:22.664802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:22.664802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:22.664802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:22.664802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:22.664802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:22.664802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:22.664802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:22.664802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:22.664802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:22.664802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:22.665740 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:22.665740 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:22.665740 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:22.665740 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:22.665740 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:22.665740 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:22.665740 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:22.665740 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:22.665740 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:22.665740 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:22.665740 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:22.665740 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:22.665740 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:22.665740 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:22.665740 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:22.665740 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:22.665740 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:22.666583 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:22.666583 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:22.666583 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:22.666583 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:22.666583 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 265/544] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:22.666855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3549a7-e180-4df0-921c-c015622f4d71 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:22.673828 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 280/545] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:39:22.675012 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b2218-ea8e-4ffa-970a-ef9a76ebccb8 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:22.756849 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:22.780534 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3549a7-e180-4df0-921c-c015622f4d71 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:22.791381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:22.801182 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0b2218-ea8e-4ffa-970a-ef9a76ebccb8 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:22.816774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578f403-5c63-48d1-9a68-02c28ec2df25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:22.817442 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578f403-5c63-48d1-9a68-02c28ec2df25 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:22.817720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578f403-5c63-48d1-9a68-02c28ec2df25 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:22.817989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d578f403-5c63-48d1-9a68-02c28ec2df25 None admin] PATH_INFO: `/v3/users` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:22.818816 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578f403-5c63-48d1-9a68-02c28ec2df25 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:22.819121 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578f403-5c63-48d1-9a68-02c28ec2df25 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:22.820582 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d578f403-5c63-48d1-9a68-02c28ec2df25 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:22.839614 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 266/546] 10.222.0.62 () {56 vars in 1133 bytes} [Wed May 25 15:39:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:22.840033 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aace40-8ed0-4c5b-a85d-f831f710d519 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:22.840406 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578f403-5c63-48d1-9a68-02c28ec2df25 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:22.840742 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aace40-8ed0-4c5b-a85d-f831f710d519 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:22.841028 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aace40-8ed0-4c5b-a85d-f831f710d519 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:22.841309 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aace40-8ed0-4c5b-a85d-f831f710d519 None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:22.842056 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aace40-8ed0-4c5b-a85d-f831f710d519 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:22.843100 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aace40-8ed0-4c5b-a85d-f831f710d519 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:22.845373 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aace40-8ed0-4c5b-a85d-f831f710d519 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:22.857995 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 281/547] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:22.859478 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306c9c7-8493-456e-b14f-cea4aba571e2 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:22.859765 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306c9c7-8493-456e-b14f-cea4aba571e2 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:22.860047 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2306c9c7-8493-456e-b14f-cea4aba571e2 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:22.861331 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 282/548] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:22.862038 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306c9c7-8493-456e-b14f-cea4aba571e2 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:22.943268 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d578f403-5c63-48d1-9a68-02c28ec2df25 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:22.967501 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2306c9c7-8493-456e-b14f-cea4aba571e2 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:22.977881 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6df4d-babe-44db-b020-1390cbb13415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:22.978939 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6df4d-babe-44db-b020-1390cbb13415 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:22.979228 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6df4d-babe-44db-b020-1390cbb13415 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:22.979508 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad6df4d-babe-44db-b020-1390cbb13415 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:22.990390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad6df4d-babe-44db-b020-1390cbb13415 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:22.992326 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:22.998122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-9ad6df4d-babe-44db-b020-1390cbb13415 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:22.998122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:22.998122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:22.998122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:22.998122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:22.998122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:22.998122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:22.998122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:22.998122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:22.998122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:22.998122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:22.998122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:22.998122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:22.998122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:22.998122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:22.998122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:22.999767 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:22.999767 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:22.999767 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:22.999767 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:22.999767 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:22.999767 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:22.999767 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:22.999767 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:22.999767 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:22.999767 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:22.999767 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:22.999767 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:22.999767 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:22.999767 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:22.999767 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:22.999767 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:23.000643 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:23.000643 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:23.000643 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:23.000643 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:23.000643 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:23.000643 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:23.000643 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:23.000643 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:23.000643 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:23.000643 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:23.000643 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:23.000643 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:23.000643 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 267/549] 10.222.0.62 () {56 vars in 1102 bytes} [Wed May 25 15:39:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:23.001310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6df4d-babe-44db-b020-1390cbb13415 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:23.008996 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca908ec7-d74d-4ac0-9b90-eac29e50aa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:23.009800 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca908ec7-d74d-4ac0-9b90-eac29e50aa0b None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:23.010086 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca908ec7-d74d-4ac0-9b90-eac29e50aa0b None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:23.010363 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca908ec7-d74d-4ac0-9b90-eac29e50aa0b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:23.021395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca908ec7-d74d-4ac0-9b90-eac29e50aa0b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:23.022905 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca908ec7-d74d-4ac0-9b90-eac29e50aa0b None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:23.029324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:23.040822 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-ca908ec7-d74d-4ac0-9b90-eac29e50aa0b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:23.040822 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:23.040822 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:23.040822 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:23.040822 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:23.040822 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:23.040822 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:23.040822 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:23.040822 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:23.040822 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:23.040822 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:23.040822 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:23.040822 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:23.040822 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:23.040822 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:23.042218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:23.042218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:23.042218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:23.042218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:23.042218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:23.042218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:23.042218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:23.042218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:23.042218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:23.042218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:23.042218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:23.042218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:23.042218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:23.042218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:23.042218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:23.042218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:23.042218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:23.043234 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:23.043234 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:23.043234 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:23.043234 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:23.043234 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 283/550] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:23.043234 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72b93d-7fcc-4d23-b37c-59531b7a1135 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:23.043561 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72b93d-7fcc-4d23-b37c-59531b7a1135 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:23.043911 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa72b93d-7fcc-4d23-b37c-59531b7a1135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:23.060956 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-fa72b93d-7fcc-4d23-b37c-59531b7a1135 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:23.062970 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-fa72b93d-7fcc-4d23-b37c-59531b7a1135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:23.109351 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad6df4d-babe-44db-b020-1390cbb13415 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:23.134088 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 284/551] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:39:23.147640 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4c4b2-6ff9-4dca-9618-e6a4e066136d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:23.157149 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4c4b2-6ff9-4dca-9618-e6a4e066136d None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:23.157149 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4c4b2-6ff9-4dca-9618-e6a4e066136d None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:23.157149 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4c4b2-6ff9-4dca-9618-e6a4e066136d None admin] PATH_INFO: `/v3/users/glance` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:23.157472 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72b93d-7fcc-4d23-b37c-59531b7a1135 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:23.157550 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4c4b2-6ff9-4dca-9618-e6a4e066136d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:23.158185 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4c4b2-6ff9-4dca-9618-e6a4e066136d None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:23.174637 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-3bd4c4b2-6ff9-4dca-9618-e6a4e066136d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 15:39:23.174637 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:23.174637 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:23.174637 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:23.174637 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:23.174637 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:23.174637 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:23.174637 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:23.174637 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:23.174637 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:23.174637 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:23.174637 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:23.174637 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:39:23.174637 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:39:23.174637 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:39:23.174637 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:39:23.175795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:23.175795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:23.175795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:39:23.175795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:23.175795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:39:23.175795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:23.175795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:23.175795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:23.175795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:23.175795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:23.175795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:23.175795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:23.175795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:23.175795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:23.175795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:23.175795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:23.175795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:23.175795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:23.177410 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:23.177410 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:23.177410 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:39:23.177410 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:39:23.177410 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:39:23.177410 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:39:23.177410 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:39:23.177410 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:39:23.177410 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 15:39:23.177410 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:23.177410 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 268/552] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:39:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:23.177410 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4c4b2-6ff9-4dca-9618-e6a4e066136d None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:23.251314 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa72b93d-7fcc-4d23-b37c-59531b7a1135 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:23.253619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:23.267782 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:23.279497 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4c4b2-6ff9-4dca-9618-e6a4e066136d None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:23.284552 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2c66d-f56f-49ef-8c88-dd2960b4769d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:23.285323 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2c66d-f56f-49ef-8c88-dd2960b4769d None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:23.285849 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2c66d-f56f-49ef-8c88-dd2960b4769d None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:23.286415 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a2c66d-f56f-49ef-8c88-dd2960b4769d None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:23.287535 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2c66d-f56f-49ef-8c88-dd2960b4769d None admin] RBAC: Adding query filter params (name=service) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:23.287874 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2c66d-f56f-49ef-8c88-dd2960b4769d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:23.289253 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a2c66d-f56f-49ef-8c88-dd2960b4769d None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:23.298344 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 285/553] 10.222.0.62 () {56 vars in 1103 bytes} [Wed May 25 15:39:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:23.299150 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2c66d-f56f-49ef-8c88-dd2960b4769d None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:23.314495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72cece-d95a-4008-af05-4bef24602332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:23.315202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72cece-d95a-4008-af05-4bef24602332 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:23.315486 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72cece-d95a-4008-af05-4bef24602332 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:23.315767 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba72cece-d95a-4008-af05-4bef24602332 None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:23.316537 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72cece-d95a-4008-af05-4bef24602332 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:23.316850 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72cece-d95a-4008-af05-4bef24602332 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:23.318236 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba72cece-d95a-4008-af05-4bef24602332 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:23.329575 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 269/554] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:23.330406 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72cece-d95a-4008-af05-4bef24602332 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:23.412956 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a2c66d-f56f-49ef-8c88-dd2960b4769d None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:23.433812 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba72cece-d95a-4008-af05-4bef24602332 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:23.447808 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2545e3c-9118-4628-90c4-6d8c164fc29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:23.449001 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2545e3c-9118-4628-90c4-6d8c164fc29d None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:23.449282 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2545e3c-9118-4628-90c4-6d8c164fc29d None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:23.449549 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2545e3c-9118-4628-90c4-6d8c164fc29d None admin] PATH_INFO: `/v3/roles/service` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:23.460258 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2545e3c-9118-4628-90c4-6d8c164fc29d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:23.468505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-c2545e3c-9118-4628-90c4-6d8c164fc29d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:23.468505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:23.468505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:23.468505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:23.468505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:23.468505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:23.468505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:23.468505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:23.468505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:23.468505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:23.468505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:23.468505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:23.468505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:23.468505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:23.468505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:23.468505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:23.469600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:23.469600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:23.469600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:23.469600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:23.469600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:23.469600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:23.469600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:23.469600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:23.469600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:23.469600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:23.469600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:23.469600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:23.469600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:23.469600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:23.469600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:23.469600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:23.470601 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:23.470601 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:23.470601 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:23.470601 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:23.470601 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:23.470601 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:23.470601 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:23.470601 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:23.470601 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:23.470601 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:23.470601 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:23.470601 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:23.471348 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd6238-7f3d-495e-bca9-2707a37d5a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:23.471348 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd6238-7f3d-495e-bca9-2707a37d5a00 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:23.471348 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd6238-7f3d-495e-bca9-2707a37d5a00 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:23.471348 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fd6238-7f3d-495e-bca9-2707a37d5a00 None admin] PATH_INFO: `/v3/users` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:23.471665 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 286/555] 10.222.0.62 () {56 vars in 1102 bytes} [Wed May 25 15:39:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:23.471665 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2545e3c-9118-4628-90c4-6d8c164fc29d None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:23.473392 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd6238-7f3d-495e-bca9-2707a37d5a00 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:23.473723 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd6238-7f3d-495e-bca9-2707a37d5a00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:23.475190 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40fd6238-7f3d-495e-bca9-2707a37d5a00 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:23.493498 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 270/556] 10.222.0.62 () {56 vars in 1137 bytes} [Wed May 25 15:39:23 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:23.494300 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd6238-7f3d-495e-bca9-2707a37d5a00 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:23.500803 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:23.506133 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:23.577430 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2545e3c-9118-4628-90c4-6d8c164fc29d None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:23.602768 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fd6238-7f3d-495e-bca9-2707a37d5a00 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:23.613028 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b8573-0a97-43e7-8d33-9c10719429d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:23.613825 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b8573-0a97-43e7-8d33-9c10719429d2 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:23.614105 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b8573-0a97-43e7-8d33-9c10719429d2 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:23.614376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b8573-0a97-43e7-8d33-9c10719429d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:23.626217 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b8573-0a97-43e7-8d33-9c10719429d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:23.627668 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b8573-0a97-43e7-8d33-9c10719429d2 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:23.637814 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d89c9-5134-41ff-b3a1-01dde4ec128f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:23.638602 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d89c9-5134-41ff-b3a1-01dde4ec128f None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:23.638880 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d89c9-5134-41ff-b3a1-01dde4ec128f None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:23.639179 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d89c9-5134-41ff-b3a1-01dde4ec128f None admin] PATH_INFO: `/v3/projects/service` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:23.646844 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-f11b8573-0a97-43e7-8d33-9c10719429d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:23.646844 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:23.646844 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:23.646844 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:23.646844 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:23.646844 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:23.646844 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:23.646844 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:23.646844 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:23.646844 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:23.646844 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:23.646844 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:23.646844 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:23.646844 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:23.646844 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:23.647792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:23.647792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:23.647792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:23.647792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:23.647792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:23.647792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:23.647792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:23.647792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:23.647792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:23.647792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:23.647792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:23.647792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:23.647792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:23.647792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:23.647792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:23.647792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:23.647792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:23.648704 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:23.648704 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:23.648704 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:23.648704 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:23.648941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d89c9-5134-41ff-b3a1-01dde4ec128f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:23.649013 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 287/557] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:23.649013 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b8573-0a97-43e7-8d33-9c10719429d2 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:23.649133 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d89c9-5134-41ff-b3a1-01dde4ec128f None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:23.665210 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-188d89c9-5134-41ff-b3a1-01dde4ec128f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:23.665210 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:23.665210 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:23.665210 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:23.665210 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:23.665210 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:23.665210 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:23.665210 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:23.665210 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:23.665210 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:23.665210 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:23.665210 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:23.665210 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:39:23.665210 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:39:23.665210 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:39:23.666824 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:39:23.666824 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:23.666824 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:23.666824 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:23.666824 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:23.666824 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:23.666824 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:23.666824 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:23.666824 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:23.666824 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:23.666824 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:23.666824 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:23.666824 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:23.666824 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:23.666824 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:23.666824 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:23.666824 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:23.668948 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:39:23.668948 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:39:23.668948 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:39:23.668948 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:39:23.668948 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:39:23.668948 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:39:23.668948 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:23.668948 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:23.668948 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 271/558] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:23.668948 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d89c9-5134-41ff-b3a1-01dde4ec128f None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:23.734782 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:23.736932 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:23.758378 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b8573-0a97-43e7-8d33-9c10719429d2 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:23.770499 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d89c9-5134-41ff-b3a1-01dde4ec128f None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:23.792486 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e1d6e-8e91-414e-a700-84b62e79e62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:23.793159 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e1d6e-8e91-414e-a700-84b62e79e62d None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:23.793447 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e1d6e-8e91-414e-a700-84b62e79e62d None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:23.793721 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027e1d6e-8e91-414e-a700-84b62e79e62d None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:23.794458 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e1d6e-8e91-414e-a700-84b62e79e62d None admin] RBAC: Adding query filter params (name=service) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:23.794813 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e1d6e-8e91-414e-a700-84b62e79e62d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:23.796199 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027e1d6e-8e91-414e-a700-84b62e79e62d None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:23.804341 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 288/559] 10.222.0.62 () {56 vars in 1103 bytes} [Wed May 25 15:39:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:23.805186 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e1d6e-8e91-414e-a700-84b62e79e62d None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:23.805451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177570e7-2838-4cb6-a873-90a008f12836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:23.806265 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177570e7-2838-4cb6-a873-90a008f12836 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:23.806620 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177570e7-2838-4cb6-a873-90a008f12836 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:23.806929 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177570e7-2838-4cb6-a873-90a008f12836 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:23.818879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177570e7-2838-4cb6-a873-90a008f12836 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:23.820353 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177570e7-2838-4cb6-a873-90a008f12836 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:23.838214 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-177570e7-2838-4cb6-a873-90a008f12836 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:23.838214 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:23.838214 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:23.838214 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:23.838214 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:23.838214 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:23.838214 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:23.838214 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:23.838214 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:23.838214 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:23.838214 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:23.838214 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:23.838214 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:23.838214 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:23.838214 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:23.839202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:23.839202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:23.839202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:23.839202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:23.839202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:23.839202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:23.839202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:23.839202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:23.839202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:23.839202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:23.839202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:23.839202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:23.839202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:23.839202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:23.839202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:23.839202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:23.839202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:23.840071 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:23.840071 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:23.840071 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:23.840071 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:23.840071 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 272/560] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:23.840338 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177570e7-2838-4cb6-a873-90a008f12836 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:23.917677 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027e1d6e-8e91-414e-a700-84b62e79e62d None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:23.949828 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177570e7-2838-4cb6-a873-90a008f12836 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:23.952463 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12564b61-492a-4ba7-a735-858b6f673af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:23.953241 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12564b61-492a-4ba7-a735-858b6f673af5 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:23.953524 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12564b61-492a-4ba7-a735-858b6f673af5 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:23.953796 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12564b61-492a-4ba7-a735-858b6f673af5 None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:23.954513 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12564b61-492a-4ba7-a735-858b6f673af5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:23.954819 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12564b61-492a-4ba7-a735-858b6f673af5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:23.956246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12564b61-492a-4ba7-a735-858b6f673af5 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:23.965960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:23.968546 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:23.974104 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 289/561] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:23.974104 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12564b61-492a-4ba7-a735-858b6f673af5 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:23.985520 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1441d9d-1243-46cb-a8da-b5957a45d281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:23.986185 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1441d9d-1243-46cb-a8da-b5957a45d281 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:23.986465 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1441d9d-1243-46cb-a8da-b5957a45d281 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:23.986745 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1441d9d-1243-46cb-a8da-b5957a45d281 None admin] PATH_INFO: `/v3/projects` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:23.987555 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1441d9d-1243-46cb-a8da-b5957a45d281 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:23.987870 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1441d9d-1243-46cb-a8da-b5957a45d281 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:23.989329 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1441d9d-1243-46cb-a8da-b5957a45d281 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:24.001204 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 273/562] 10.222.0.62 () {56 vars in 1148 bytes} [Wed May 25 15:39:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:24.002002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1441d9d-1243-46cb-a8da-b5957a45d281 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:24.073693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12564b61-492a-4ba7-a735-858b6f673af5 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:24.105696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1441d9d-1243-46cb-a8da-b5957a45d281 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:24.107767 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44192adf-8f0d-4129-850f-a22227a0cd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:24.109207 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44192adf-8f0d-4129-850f-a22227a0cd0f None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:24.109579 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44192adf-8f0d-4129-850f-a22227a0cd0f None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:24.109900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44192adf-8f0d-4129-850f-a22227a0cd0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:24.120291 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44192adf-8f0d-4129-850f-a22227a0cd0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:24.121755 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44192adf-8f0d-4129-850f-a22227a0cd0f None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:24.142139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-44192adf-8f0d-4129-850f-a22227a0cd0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:24.142139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:24.142139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:24.142139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:24.142139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:24.142139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:24.142139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:24.142139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:24.142139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:24.142139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:24.142139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:24.142139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:24.142139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:24.142139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:24.142139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:24.143209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:24.143209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:24.143209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:24.143209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:24.143209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:24.143209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:24.143209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:24.143209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:24.143209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:24.143209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:24.143209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:24.143209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:24.143209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:24.143209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:24.143209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:24.143209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:24.143209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:24.144551 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:24.144551 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:24.144551 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:24.144551 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:24.144551 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 290/563] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:24.144856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44192adf-8f0d-4129-850f-a22227a0cd0f None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:24.145697 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebdf09-348b-4cf7-9e46-0d78f45eeb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:24.146477 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebdf09-348b-4cf7-9e46-0d78f45eeb8f None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:24.146854 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebdf09-348b-4cf7-9e46-0d78f45eeb8f None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:24.147221 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ebdf09-348b-4cf7-9e46-0d78f45eeb8f None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:24.148128 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebdf09-348b-4cf7-9e46-0d78f45eeb8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:24.148408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebdf09-348b-4cf7-9e46-0d78f45eeb8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:24.149813 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ebdf09-348b-4cf7-9e46-0d78f45eeb8f None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:24.161501 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 274/564] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:24.162286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebdf09-348b-4cf7-9e46-0d78f45eeb8f None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:24.202316 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:24.203784 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:24.249654 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44192adf-8f0d-4129-850f-a22227a0cd0f None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:24.261167 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ebdf09-348b-4cf7-9e46-0d78f45eeb8f None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:24.284714 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cee87c-29c3-4429-8e87-49aa99d7080e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:24.285506 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cee87c-29c3-4429-8e87-49aa99d7080e None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:24.285791 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cee87c-29c3-4429-8e87-49aa99d7080e None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:24.286066 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cee87c-29c3-4429-8e87-49aa99d7080e None admin] PATH_INFO: `/v3/users/cinder` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:24.293445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cee87c-29c3-4429-8e87-49aa99d7080e None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:24.294880 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cee87c-29c3-4429-8e87-49aa99d7080e None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:24.295382 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a0acb-0738-4d80-a59f-2b986f3ef019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:24.296525 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a0acb-0738-4d80-a59f-2b986f3ef019 None admin] REQUEST_METHOD: `PUT` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:24.296968 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a0acb-0738-4d80-a59f-2b986f3ef019 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:24.297314 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6a0acb-0738-4d80-a59f-2b986f3ef019 None admin] PATH_INFO: `/v3/projects/5e951a6f0d6947dfae3ac132afbcd4b5/users/d9b8b255e35c4949ba8faeb79921f141/roles/d1d28f6c8cb34e9f8af7cda9d128a351` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:24.309567 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-74cee87c-29c3-4429-8e87-49aa99d7080e None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:39:24.309567 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:24.309567 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:24.309567 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:24.309567 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:24.309567 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:24.309567 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:24.309567 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:24.309567 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:24.309567 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:24.309567 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:24.309567 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:24.309567 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:39:24.309567 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:39:24.309567 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:39:24.309567 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:39:24.310810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:24.310810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:24.310810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:39:24.310810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:24.310810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:39:24.310810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:24.310810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:24.310810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:24.310810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:24.310810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:24.310810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:24.310810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:24.310810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:24.310810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:24.310810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:24.310810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:24.310810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:24.310810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:24.312960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:24.312960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:24.312960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:39:24.312960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:39:24.312960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:39:24.312960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:39:24.312960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:39:24.312960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:39:24.312960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:39:24.312960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:24.312960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 291/565] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:39:24 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:24.312960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cee87c-29c3-4429-8e87-49aa99d7080e None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:24.316060 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a0acb-0738-4d80-a59f-2b986f3ef019 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e951a6f0d6947dfae3ac132afbcd4b5, user_id=d9b8b255e35c4949ba8faeb79921f141, role_id=d1d28f6c8cb34e9f8af7cda9d128a351)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:24.317572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6a0acb-0738-4d80-a59f-2b986f3ef019 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:24.414507 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cee87c-29c3-4429-8e87-49aa99d7080e None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:24.424761 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 275/566] 10.222.0.62 () {58 vars in 1439 bytes} [Wed May 25 15:39:24 2022] PUT /identity/v3/projects/5e951a6f0d6947dfae3ac132afbcd4b5/users/d9b8b255e35c4949ba8faeb79921f141/roles/d1d28f6c8cb34e9f8af7cda9d128a351 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:39:24.425726 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a0acb-0738-4d80-a59f-2b986f3ef019 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:24.431459 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:24.453443 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6dfcf-d108-401a-aba5-481b2e9e7415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:24.453793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6dfcf-d108-401a-aba5-481b2e9e7415 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:24.454029 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6dfcf-d108-401a-aba5-481b2e9e7415 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:24.454313 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6dfcf-d108-401a-aba5-481b2e9e7415 None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:24.455067 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6dfcf-d108-401a-aba5-481b2e9e7415 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:24.455377 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6dfcf-d108-401a-aba5-481b2e9e7415 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:24.456869 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6dfcf-d108-401a-aba5-481b2e9e7415 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:24.470221 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 292/567] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:24.471002 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6dfcf-d108-401a-aba5-481b2e9e7415 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:24.553259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:24.566990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6a0acb-0738-4d80-a59f-2b986f3ef019 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:24.590197 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6dfcf-d108-401a-aba5-481b2e9e7415 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:24.608393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685160d5-fa46-4e0a-9977-27eb8e198eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:24.608393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685160d5-fa46-4e0a-9977-27eb8e198eaf None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:24.608393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685160d5-fa46-4e0a-9977-27eb8e198eaf None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:24.608393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685160d5-fa46-4e0a-9977-27eb8e198eaf None admin] PATH_INFO: `/v3/projects/service` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:24.615544 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685160d5-fa46-4e0a-9977-27eb8e198eaf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:24.617141 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685160d5-fa46-4e0a-9977-27eb8e198eaf None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:24.634491 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-685160d5-fa46-4e0a-9977-27eb8e198eaf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:24.634491 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:24.634491 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:24.634491 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:24.634491 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:24.634491 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:24.634491 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:24.634491 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:24.634491 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:24.634491 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:24.634491 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:24.634491 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:24.634491 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:39:24.634491 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:39:24.634491 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:39:24.635704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:39:24.635704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:24.635704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:24.635704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:24.635704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:24.635704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:24.635704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:24.635704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:24.635704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:24.635704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:24.635704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:24.635704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:24.635704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:24.635704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:24.635704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:24.635704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:24.635704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:24.636828 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:39:24.636828 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:39:24.636828 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:39:24.636828 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:39:24.636828 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:39:24.636828 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:39:24.636828 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:24.636828 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:24.636828 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 276/568] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:24.637459 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685160d5-fa46-4e0a-9977-27eb8e198eaf None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:24.642394 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645c0ad-d8d2-4906-8179-ff743c6c7291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:24.643179 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645c0ad-d8d2-4906-8179-ff743c6c7291 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:24.643527 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645c0ad-d8d2-4906-8179-ff743c6c7291 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:24.643873 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645c0ad-d8d2-4906-8179-ff743c6c7291 None admin] PATH_INFO: `/v3/users` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:24.645071 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645c0ad-d8d2-4906-8179-ff743c6c7291 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:24.645445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645c0ad-d8d2-4906-8179-ff743c6c7291 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:24.647442 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645c0ad-d8d2-4906-8179-ff743c6c7291 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:24.672164 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 293/569] 10.222.0.62 () {56 vars in 1137 bytes} [Wed May 25 15:39:24 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:24.673319 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645c0ad-d8d2-4906-8179-ff743c6c7291 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:24.712240 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:24.749944 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685160d5-fa46-4e0a-9977-27eb8e198eaf None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:24.788885 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645c0ad-d8d2-4906-8179-ff743c6c7291 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:24.789746 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f382c43-20e1-4360-ac47-21715ba835fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:24.790823 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f382c43-20e1-4360-ac47-21715ba835fd None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:24.791326 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f382c43-20e1-4360-ac47-21715ba835fd None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:24.791681 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f382c43-20e1-4360-ac47-21715ba835fd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:24.801656 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f382c43-20e1-4360-ac47-21715ba835fd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:24.803109 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f382c43-20e1-4360-ac47-21715ba835fd None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:24.819898 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-2f382c43-20e1-4360-ac47-21715ba835fd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 15:39:24.819898 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:24.819898 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:24.819898 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:24.819898 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:24.819898 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:24.819898 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:24.819898 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:24.819898 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:24.819898 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:24.819898 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:24.819898 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:24.819898 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:39:24.819898 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:39:24.819898 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:39:24.819898 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:39:24.821091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:24.821091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:24.821091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:39:24.821091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:24.821091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:39:24.821091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:24.821091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:24.821091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:24.821091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:24.821091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:24.821091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:24.821091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:24.821091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:24.821091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:24.821091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:24.821091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:24.821091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:24.821091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:24.822312 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:24.822312 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:24.822312 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:39:24.822312 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:39:24.822312 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:39:24.822312 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:39:24.822312 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:39:24.822312 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:39:24.822312 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 15:39:24.822312 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:24.825581 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 277/570] 10.222.0.62 () {56 vars in 1102 bytes} [Wed May 25 15:39:24 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:24.826469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f382c43-20e1-4360-ac47-21715ba835fd None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:24.828796 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435aab57-95e0-44af-940b-5b20e8fe6a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:24.829505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435aab57-95e0-44af-940b-5b20e8fe6a5b None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:24.829764 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435aab57-95e0-44af-940b-5b20e8fe6a5b None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:24.830059 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435aab57-95e0-44af-940b-5b20e8fe6a5b None admin] PATH_INFO: `/v3/projects` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:24.830858 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435aab57-95e0-44af-940b-5b20e8fe6a5b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:24.831164 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435aab57-95e0-44af-940b-5b20e8fe6a5b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:24.832700 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435aab57-95e0-44af-940b-5b20e8fe6a5b None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:24.840349 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:24.845330 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 294/571] 10.222.0.62 () {56 vars in 1148 bytes} [Wed May 25 15:39:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:24.846074 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435aab57-95e0-44af-940b-5b20e8fe6a5b None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:24.943275 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:24.947396 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f382c43-20e1-4360-ac47-21715ba835fd None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:24.954314 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435aab57-95e0-44af-940b-5b20e8fe6a5b None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:24.992376 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2c56b-39c9-45ba-acd4-6c9e0662aac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:24.993119 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2c56b-39c9-45ba-acd4-6c9e0662aac8 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:24.993405 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2c56b-39c9-45ba-acd4-6c9e0662aac8 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:24.993686 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2c56b-39c9-45ba-acd4-6c9e0662aac8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:24.993997 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f651ee7-9e54-419e-9401-f7dfcaa9cfe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:24.994781 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f651ee7-9e54-419e-9401-f7dfcaa9cfe7 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:24.995193 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f651ee7-9e54-419e-9401-f7dfcaa9cfe7 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:24.995573 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f651ee7-9e54-419e-9401-f7dfcaa9cfe7 None admin] PATH_INFO: `/v3/users` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:24.996510 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f651ee7-9e54-419e-9401-f7dfcaa9cfe7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:24.996896 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f651ee7-9e54-419e-9401-f7dfcaa9cfe7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:24.998426 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f651ee7-9e54-419e-9401-f7dfcaa9cfe7 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:25.005383 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2c56b-39c9-45ba-acd4-6c9e0662aac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:25.007054 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2c56b-39c9-45ba-acd4-6c9e0662aac8 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:25.023689 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 295/572] 10.222.0.62 () {56 vars in 1139 bytes} [Wed May 25 15:39:24 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:25.023689 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f651ee7-9e54-419e-9401-f7dfcaa9cfe7 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:25.026118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-57c2c56b-39c9-45ba-acd4-6c9e0662aac8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:25.026118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:25.026118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:25.026118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:25.026118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:25.026118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:25.026118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:25.026118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:25.026118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:25.026118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:25.026118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:25.026118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:25.026118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:25.026118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:25.026118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:25.027033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:25.027033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:25.027033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:25.027033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:25.027033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:25.027033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:25.027033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:25.027033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:25.027033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:25.027033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:25.027033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:25.027033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:25.027033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:25.027033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:25.027033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:25.027033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:25.027033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:25.027937 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:25.027937 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:25.027937 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:25.027937 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:25.032719 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 278/573] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:25.033904 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2c56b-39c9-45ba-acd4-6c9e0662aac8 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:25.099285 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:25.145206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f651ee7-9e54-419e-9401-f7dfcaa9cfe7 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:25.152993 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2c56b-39c9-45ba-acd4-6c9e0662aac8 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:25.181707 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b9239-12a5-4861-a632-efc37900d569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:25.182596 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b9239-12a5-4861-a632-efc37900d569 None admin] REQUEST_METHOD: `PUT` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:25.183004 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b9239-12a5-4861-a632-efc37900d569 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:25.183296 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895b9239-12a5-4861-a632-efc37900d569 None admin] PATH_INFO: `/v3/projects/5e951a6f0d6947dfae3ac132afbcd4b5/users/530c527ef42e4f949b15c74206baf99b/roles/d1d28f6c8cb34e9f8af7cda9d128a351` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:25.190889 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd2d43-6300-4711-824c-2861ddaffe81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:25.191687 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd2d43-6300-4711-824c-2861ddaffe81 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:25.191895 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd2d43-6300-4711-824c-2861ddaffe81 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:25.192163 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd2d43-6300-4711-824c-2861ddaffe81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:25.200758 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b9239-12a5-4861-a632-efc37900d569 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e951a6f0d6947dfae3ac132afbcd4b5, user_id=530c527ef42e4f949b15c74206baf99b, role_id=d1d28f6c8cb34e9f8af7cda9d128a351)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:25.203000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895b9239-12a5-4861-a632-efc37900d569 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:25.204309 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd2d43-6300-4711-824c-2861ddaffe81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:25.205783 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd2d43-6300-4711-824c-2861ddaffe81 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:25.223361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-8cfd2d43-6300-4711-824c-2861ddaffe81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:25.223361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:25.223361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:25.223361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:25.223361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:25.223361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:25.223361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:25.223361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:25.223361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:25.223361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:25.223361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:25.223361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:25.223361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:25.223361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:25.223361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:25.224324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:25.224324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:25.224324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:25.224324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:25.224324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:25.224324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:25.224324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:25.224324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:25.224324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:25.224324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:25.224324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:25.224324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:25.224324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:25.224324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:25.224324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:25.224324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:25.224324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:25.225278 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:25.225278 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:25.225278 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:25.225278 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:25.225278 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 279/574] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:25.225559 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd2d43-6300-4711-824c-2861ddaffe81 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:25.264641 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:25.280444 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 296/575] 10.222.0.62 () {58 vars in 1439 bytes} [Wed May 25 15:39:25 2022] PUT /identity/v3/projects/5e951a6f0d6947dfae3ac132afbcd4b5/users/530c527ef42e4f949b15c74206baf99b/roles/d1d28f6c8cb34e9f8af7cda9d128a351 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:39:25.280444 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b9239-12a5-4861-a632-efc37900d569 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:25.363203 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd2d43-6300-4711-824c-2861ddaffe81 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:25.379394 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:25.391308 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895b9239-12a5-4861-a632-efc37900d569 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:25.406395 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c289c52-ac46-4889-970f-fd98a0343330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:25.407467 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c289c52-ac46-4889-970f-fd98a0343330 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:25.407925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c289c52-ac46-4889-970f-fd98a0343330 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:25.408362 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c289c52-ac46-4889-970f-fd98a0343330 None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:25.409610 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c289c52-ac46-4889-970f-fd98a0343330 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:25.410123 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c289c52-ac46-4889-970f-fd98a0343330 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:25.411760 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c289c52-ac46-4889-970f-fd98a0343330 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:25.431950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 280/576] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:25.433867 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c289c52-ac46-4889-970f-fd98a0343330 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:25.440619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1226e-431a-4f71-a645-b1c6dc89ac68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:25.441735 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1226e-431a-4f71-a645-b1c6dc89ac68 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:25.442253 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1226e-431a-4f71-a645-b1c6dc89ac68 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:25.442792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f1226e-431a-4f71-a645-b1c6dc89ac68 None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:25.445227 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1226e-431a-4f71-a645-b1c6dc89ac68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:25.445798 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1226e-431a-4f71-a645-b1c6dc89ac68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:25.448005 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f1226e-431a-4f71-a645-b1c6dc89ac68 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:25.465386 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 297/577] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:25.471865 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1226e-431a-4f71-a645-b1c6dc89ac68 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:25.546242 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:25.574179 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c289c52-ac46-4889-970f-fd98a0343330 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:25.593255 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f1226e-431a-4f71-a645-b1c6dc89ac68 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:25.624461 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff237f8-fb88-4ed0-9ec5-3b3211a6fd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:25.625861 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff237f8-fb88-4ed0-9ec5-3b3211a6fd50 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:25.626215 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff237f8-fb88-4ed0-9ec5-3b3211a6fd50 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:25.626493 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff237f8-fb88-4ed0-9ec5-3b3211a6fd50 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:25.634276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff237f8-fb88-4ed0-9ec5-3b3211a6fd50 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:25.635833 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff237f8-fb88-4ed0-9ec5-3b3211a6fd50 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:25.637275 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6d793-0381-4b9a-84e7-15533a7b8d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:25.638795 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6d793-0381-4b9a-84e7-15533a7b8d2e None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:25.640040 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6d793-0381-4b9a-84e7-15533a7b8d2e None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:25.640556 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f6d793-0381-4b9a-84e7-15533a7b8d2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:25.648884 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6d793-0381-4b9a-84e7-15533a7b8d2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:25.650622 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f6d793-0381-4b9a-84e7-15533a7b8d2e None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:25.655524 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-6ff237f8-fb88-4ed0-9ec5-3b3211a6fd50 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:25.655524 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:25.655524 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:25.655524 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:25.655524 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:25.655524 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:25.655524 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:25.655524 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:25.655524 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:25.655524 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:25.655524 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:25.655524 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:25.655524 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:39:25.655524 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:39:25.655524 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:39:25.656450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:39:25.656450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:25.656450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:25.656450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:25.656450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:25.656450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:25.656450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:25.656450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:25.656450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:25.656450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:25.656450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:25.656450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:25.656450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:25.656450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:25.656450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:25.656450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:25.656450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:25.657344 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:39:25.657344 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:39:25.657344 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:39:25.657344 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:39:25.657344 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:39:25.657344 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:39:25.657344 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:25.657344 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:25.657344 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 281/578] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:39:25.662396 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff237f8-fb88-4ed0-9ec5-3b3211a6fd50 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:25.674815 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-72f6d793-0381-4b9a-84e7-15533a7b8d2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:25.674815 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:25.674815 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:25.674815 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:25.674815 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:25.674815 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:25.674815 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:25.674815 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:25.674815 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:25.674815 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:25.674815 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:25.674815 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:25.674815 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:39:25.674815 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:39:25.674815 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:39:25.675753 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:39:25.675753 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:25.675753 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:25.675753 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:25.675753 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:25.675753 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:25.675753 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:25.675753 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:25.675753 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:25.675753 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:25.675753 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:25.675753 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:25.675753 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:25.675753 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:25.675753 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:25.675753 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:25.675753 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:25.676660 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:39:25.676660 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:39:25.676660 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:39:25.676660 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:39:25.676660 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:39:25.676660 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:39:25.676660 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:25.676660 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:25.678812 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 298/579] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:25.683450 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6d793-0381-4b9a-84e7-15533a7b8d2e None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:25.700654 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:25.782382 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff237f8-fb88-4ed0-9ec5-3b3211a6fd50 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:25.822360 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f6d793-0381-4b9a-84e7-15533a7b8d2e None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:25.828615 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5af3c-43a3-4243-bb7f-911f5dd6e18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:25.829564 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5af3c-43a3-4243-bb7f-911f5dd6e18f None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:25.830090 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5af3c-43a3-4243-bb7f-911f5dd6e18f None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:25.831119 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a5af3c-43a3-4243-bb7f-911f5dd6e18f None admin] PATH_INFO: `/v3/projects` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:25.832109 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5af3c-43a3-4243-bb7f-911f5dd6e18f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:25.833077 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5af3c-43a3-4243-bb7f-911f5dd6e18f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:25.835135 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a5af3c-43a3-4243-bb7f-911f5dd6e18f None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:25.842172 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:25.853760 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 282/580] 10.222.0.62 () {56 vars in 1148 bytes} [Wed May 25 15:39:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:25.860035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5af3c-43a3-4243-bb7f-911f5dd6e18f None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:25.867174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947720f-c604-437f-a9ef-51120ede8c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:25.867855 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947720f-c604-437f-a9ef-51120ede8c5a None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:25.868137 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947720f-c604-437f-a9ef-51120ede8c5a None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:25.868434 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947720f-c604-437f-a9ef-51120ede8c5a None admin] PATH_INFO: `/v3/projects` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:25.869312 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947720f-c604-437f-a9ef-51120ede8c5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:25.869618 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947720f-c604-437f-a9ef-51120ede8c5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:25.871046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947720f-c604-437f-a9ef-51120ede8c5a None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:25.886976 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 299/581] 10.222.0.62 () {56 vars in 1148 bytes} [Wed May 25 15:39:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:25.892289 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947720f-c604-437f-a9ef-51120ede8c5a None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:25.978175 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:25.987951 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a5af3c-43a3-4243-bb7f-911f5dd6e18f None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:26.011705 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947720f-c604-437f-a9ef-51120ede8c5a None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:26.034381 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96bbcde-695f-4f61-9307-811802ed24ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:26.035303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96bbcde-695f-4f61-9307-811802ed24ef None admin] REQUEST_METHOD: `PUT` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:26.035589 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96bbcde-695f-4f61-9307-811802ed24ef None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:26.035866 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96bbcde-695f-4f61-9307-811802ed24ef None admin] PATH_INFO: `/v3/projects/5e951a6f0d6947dfae3ac132afbcd4b5/users/45fabc3594f64571a0b381990b7974f8/roles/d1d28f6c8cb34e9f8af7cda9d128a351` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:26.053907 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96bbcde-695f-4f61-9307-811802ed24ef None admin] RBAC: Authorizing `identity:create_grant(project_id=5e951a6f0d6947dfae3ac132afbcd4b5, user_id=45fabc3594f64571a0b381990b7974f8, role_id=d1d28f6c8cb34e9f8af7cda9d128a351)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:26.055367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96bbcde-695f-4f61-9307-811802ed24ef None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:26.057692 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7253275-ce4b-46ee-8843-050ac9c23d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:26.059049 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7253275-ce4b-46ee-8843-050ac9c23d8c None admin] REQUEST_METHOD: `PUT` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:26.059537 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7253275-ce4b-46ee-8843-050ac9c23d8c None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:26.065359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7253275-ce4b-46ee-8843-050ac9c23d8c None admin] PATH_INFO: `/v3/projects/5e951a6f0d6947dfae3ac132afbcd4b5/users/d1cb7a1be78c4b55b5ec991b99d47020/roles/d1d28f6c8cb34e9f8af7cda9d128a351` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:26.076671 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7253275-ce4b-46ee-8843-050ac9c23d8c None admin] RBAC: Authorizing `identity:create_grant(project_id=5e951a6f0d6947dfae3ac132afbcd4b5, user_id=d1cb7a1be78c4b55b5ec991b99d47020, role_id=d1d28f6c8cb34e9f8af7cda9d128a351)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:26.078396 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7253275-ce4b-46ee-8843-050ac9c23d8c None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:26.157403 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 283/582] 10.222.0.62 () {58 vars in 1439 bytes} [Wed May 25 15:39:25 2022] PUT /identity/v3/projects/5e951a6f0d6947dfae3ac132afbcd4b5/users/45fabc3594f64571a0b381990b7974f8/roles/d1d28f6c8cb34e9f8af7cda9d128a351 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:39:26.230622 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 300/583] 10.222.0.62 () {58 vars in 1439 bytes} [Wed May 25 15:39:25 2022] PUT /identity/v3/projects/5e951a6f0d6947dfae3ac132afbcd4b5/users/d1cb7a1be78c4b55b5ec991b99d47020/roles/d1d28f6c8cb34e9f8af7cda9d128a351 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:39:26.778334 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0bef8-dfe6-4fbe-8d7f-1c917f319848 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:26.778876 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0bef8-dfe6-4fbe-8d7f-1c917f319848 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:26.778876 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0bef8-dfe6-4fbe-8d7f-1c917f319848 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:26.781169 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 284/584] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:26.786455 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf6e8e-5528-4b18-bb6e-93d030d3e921 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:26.786924 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf6e8e-5528-4b18-bb6e-93d030d3e921 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:26.787036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaf6e8e-5528-4b18-bb6e-93d030d3e921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:26.804508 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-adaf6e8e-5528-4b18-bb6e-93d030d3e921 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:26.805704 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-adaf6e8e-5528-4b18-bb6e-93d030d3e921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:26.830643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:26.876359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 301/585] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:39:26.904072 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0bef8-dfe6-4fbe-8d7f-1c917f319848 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:27.018182 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0bef8-dfe6-4fbe-8d7f-1c917f319848 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:27.056211 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8ba53-5ebe-4705-b731-4e0587e42f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:27.057308 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8ba53-5ebe-4705-b731-4e0587e42f52 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:27.057841 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8ba53-5ebe-4705-b731-4e0587e42f52 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:27.067184 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8ba53-5ebe-4705-b731-4e0587e42f52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:27.074532 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b8ba53-5ebe-4705-b731-4e0587e42f52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:27.086733 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-e3b8ba53-5ebe-4705-b731-4e0587e42f52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:27.086733 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:27.086733 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:27.086733 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:27.086733 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:27.086733 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:27.086733 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:27.086733 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:27.086733 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:27.086733 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:27.086733 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:27.086733 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:27.086733 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:27.086733 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:27.086733 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:27.086733 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:27.088393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:27.088393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:27.088393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:27.088393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:27.088393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:27.088393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:27.088393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:27.088393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:27.088393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:27.088393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:27.088393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:27.088393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:27.088393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:27.088393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:27.088393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:27.088393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:27.089845 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:27.089845 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:27.089845 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:27.089845 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:27.089845 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:27.089845 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:27.089845 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:27.089845 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:27.089845 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:27.089845 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:27.089845 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:27.089845 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:27.089845 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 285/586] 10.222.0.62 () {56 vars in 1102 bytes} [Wed May 25 15:39:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:27.093991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf6e8e-5528-4b18-bb6e-93d030d3e921 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:27.211552 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaf6e8e-5528-4b18-bb6e-93d030d3e921 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:27.247792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216b5dc-dc8e-4dd2-aa91-89fa8862c3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:27.249013 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216b5dc-dc8e-4dd2-aa91-89fa8862c3a0 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:27.249305 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216b5dc-dc8e-4dd2-aa91-89fa8862c3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:27.249583 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4216b5dc-dc8e-4dd2-aa91-89fa8862c3a0 None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:27.250328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216b5dc-dc8e-4dd2-aa91-89fa8862c3a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:27.250631 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216b5dc-dc8e-4dd2-aa91-89fa8862c3a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:27.252175 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4216b5dc-dc8e-4dd2-aa91-89fa8862c3a0 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:27.261118 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 302/587] 10.222.0.62 () {56 vars in 1103 bytes} [Wed May 25 15:39:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:27.269745 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8ba53-5ebe-4705-b731-4e0587e42f52 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:27.272851 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:27.375780 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b8ba53-5ebe-4705-b731-4e0587e42f52 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:27.418968 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb4663-2e16-4266-99e1-9e5e41bafa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:27.419871 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb4663-2e16-4266-99e1-9e5e41bafa04 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:27.420228 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb4663-2e16-4266-99e1-9e5e41bafa04 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:27.421143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeb4663-2e16-4266-99e1-9e5e41bafa04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:27.432256 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb4663-2e16-4266-99e1-9e5e41bafa04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:27.433834 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eeb4663-2e16-4266-99e1-9e5e41bafa04 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:27.454544 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-0eeb4663-2e16-4266-99e1-9e5e41bafa04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:27.454544 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:27.454544 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:27.454544 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:27.454544 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:27.454544 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:27.454544 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:27.454544 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:27.454544 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:27.454544 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:27.454544 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:27.454544 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:27.454544 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:27.454544 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:27.454544 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:27.455652 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:27.455652 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:27.455652 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:27.455652 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:27.455652 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:27.455652 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:27.455652 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:27.455652 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:27.455652 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:27.455652 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:27.455652 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:27.455652 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:27.455652 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:27.455652 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:27.455652 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:27.455652 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:27.455652 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:27.456814 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:27.456814 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:27.456814 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:27.456814 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:27.457954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 286/588] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:27.465722 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216b5dc-dc8e-4dd2-aa91-89fa8862c3a0 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:27.492941 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:27.585356 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4216b5dc-dc8e-4dd2-aa91-89fa8862c3a0 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:27.620864 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5a31d-1c5f-4fa4-b4bd-b418b705f77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:27.621875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5a31d-1c5f-4fa4-b4bd-b418b705f77e None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:27.622402 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5a31d-1c5f-4fa4-b4bd-b418b705f77e None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:27.622881 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5a31d-1c5f-4fa4-b4bd-b418b705f77e None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:27.624132 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5a31d-1c5f-4fa4-b4bd-b418b705f77e None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:27.625014 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5a31d-1c5f-4fa4-b4bd-b418b705f77e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:27.627601 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5a31d-1c5f-4fa4-b4bd-b418b705f77e None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:27.641857 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 303/589] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:27.648541 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb4663-2e16-4266-99e1-9e5e41bafa04 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:27.710971 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0c31f-6794-4981-b0da-406fda80ed97 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:27.711327 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0c31f-6794-4981-b0da-406fda80ed97 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:27.711541 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd0c31f-6794-4981-b0da-406fda80ed97 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:27.714493 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 304/590] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:27.715056 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:27.718898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f4887-07f6-4a5f-87a6-f4f58a960b0c None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:27.719226 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f4887-07f6-4a5f-87a6-f4f58a960b0c None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:27.719508 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495f4887-07f6-4a5f-87a6-f4f58a960b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:27.740184 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-495f4887-07f6-4a5f-87a6-f4f58a960b0c None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:27.741777 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-495f4887-07f6-4a5f-87a6-f4f58a960b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:27.763698 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eeb4663-2e16-4266-99e1-9e5e41bafa04 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:27.806089 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9d011-caf3-4649-b9d8-04d4bfab20d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:27.807574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9d011-caf3-4649-b9d8-04d4bfab20d9 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:27.808053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9d011-caf3-4649-b9d8-04d4bfab20d9 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:27.808541 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a9d011-caf3-4649-b9d8-04d4bfab20d9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:27.821994 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9d011-caf3-4649-b9d8-04d4bfab20d9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:27.823743 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a9d011-caf3-4649-b9d8-04d4bfab20d9 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:27.832460 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 305/591] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:39:27.839990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-99a9d011-caf3-4649-b9d8-04d4bfab20d9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 15:39:27.839990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:27.839990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:27.839990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:27.839990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:27.839990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:27.839990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:27.839990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:27.839990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:27.839990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:27.839990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:27.839990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:27.839990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:39:27.839990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:39:27.839990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:39:27.839990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:39:27.841053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:27.841053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:27.841053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:39:27.841053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:27.841053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:39:27.841053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:27.841053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:27.841053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:27.841053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:27.841053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:27.841053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:27.841053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:27.841053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:27.841053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:27.841053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:27.841053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:27.841053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:27.841053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:27.843049 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:27.843049 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:27.843049 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:39:27.843049 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:39:27.843049 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:39:27.843049 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:39:27.843049 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:39:27.843049 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:39:27.843049 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 15:39:27.843049 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:27.843049 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 287/592] 10.222.0.62 () {56 vars in 1093 bytes} [Wed May 25 15:39:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:27.849503 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f4887-07f6-4a5f-87a6-f4f58a960b0c None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:27.857573 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9d011-caf3-4649-b9d8-04d4bfab20d9 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:27.869983 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:27.972918 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a9d011-caf3-4649-b9d8-04d4bfab20d9 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:27.988473 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:27.990876 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495f4887-07f6-4a5f-87a6-f4f58a960b0c None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:28.010707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff16de2-6fa8-4bde-92d4-f3bef5d27368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:28.011592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff16de2-6fa8-4bde-92d4-f3bef5d27368 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:28.011801 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff16de2-6fa8-4bde-92d4-f3bef5d27368 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:28.012136 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff16de2-6fa8-4bde-92d4-f3bef5d27368 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:28.025270 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff16de2-6fa8-4bde-92d4-f3bef5d27368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:28.033950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-6ff16de2-6fa8-4bde-92d4-f3bef5d27368 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:28.033950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:28.033950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:28.033950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:28.033950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:28.033950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:28.033950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:28.033950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:28.033950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:28.033950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:28.033950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:28.033950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:28.033950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:28.033950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:28.033950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:28.033950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:28.034923 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:28.034923 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:28.034923 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:28.034923 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:28.034923 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:28.034923 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:28.034923 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:28.034923 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:28.034923 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:28.034923 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:28.034923 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:28.034923 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:28.034923 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:28.034923 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:28.034923 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:28.034923 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:28.040714 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:28.040714 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:28.040714 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:28.040714 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:28.040714 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:28.040714 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:28.040714 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:28.040714 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:28.040714 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:28.040714 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:28.040714 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:28.040714 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:28.040714 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 288/593] 10.222.0.62 () {56 vars in 1102 bytes} [Wed May 25 15:39:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:39:28.041448 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a480485-0714-427f-b7d4-141aa1eed95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:28.041448 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a480485-0714-427f-b7d4-141aa1eed95e None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:28.041448 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a480485-0714-427f-b7d4-141aa1eed95e None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:28.041448 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a480485-0714-427f-b7d4-141aa1eed95e None admin] PATH_INFO: `/v3/users` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:28.041720 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a480485-0714-427f-b7d4-141aa1eed95e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:28.041720 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a480485-0714-427f-b7d4-141aa1eed95e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:28.042606 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a480485-0714-427f-b7d4-141aa1eed95e None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:28.046874 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff16de2-6fa8-4bde-92d4-f3bef5d27368 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:28.064271 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 306/594] 10.222.0.62 () {56 vars in 1133 bytes} [Wed May 25 15:39:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:28.070155 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a480485-0714-427f-b7d4-141aa1eed95e None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:28.150726 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:28.188849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff16de2-6fa8-4bde-92d4-f3bef5d27368 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:28.193624 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a480485-0714-427f-b7d4-141aa1eed95e None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:28.226426 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363f432-d41b-4814-aca7-662a547b7066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:28.227153 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363f432-d41b-4814-aca7-662a547b7066 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:28.227533 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363f432-d41b-4814-aca7-662a547b7066 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:28.228113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363f432-d41b-4814-aca7-662a547b7066 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:28.228773 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363f432-d41b-4814-aca7-662a547b7066 None admin] RBAC: Adding query filter params (name=service) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:28.229175 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363f432-d41b-4814-aca7-662a547b7066 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:28.230681 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0363f432-d41b-4814-aca7-662a547b7066 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:28.244829 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 289/595] 10.222.0.62 () {56 vars in 1103 bytes} [Wed May 25 15:39:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:28.246442 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363f432-d41b-4814-aca7-662a547b7066 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:28.249535 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25903aec-3634-49f1-9be9-b092d7983166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:28.250443 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25903aec-3634-49f1-9be9-b092d7983166 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:28.250721 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25903aec-3634-49f1-9be9-b092d7983166 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:28.250994 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25903aec-3634-49f1-9be9-b092d7983166 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:28.292486 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:28.352195 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25903aec-3634-49f1-9be9-b092d7983166 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:28.354304 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25903aec-3634-49f1-9be9-b092d7983166 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:28.364839 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363f432-d41b-4814-aca7-662a547b7066 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:28.402747 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727885d-9667-4e0e-82e8-581acf8acfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:28.403120 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727885d-9667-4e0e-82e8-581acf8acfb6 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:28.403499 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727885d-9667-4e0e-82e8-581acf8acfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:28.403945 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4727885d-9667-4e0e-82e8-581acf8acfb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:28.417835 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727885d-9667-4e0e-82e8-581acf8acfb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:28.419609 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4727885d-9667-4e0e-82e8-581acf8acfb6 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:28.441308 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-4727885d-9667-4e0e-82e8-581acf8acfb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:28.441308 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:28.441308 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:28.441308 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:28.441308 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:28.441308 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:28.441308 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:28.441308 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:28.441308 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:28.441308 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:28.441308 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:28.441308 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:28.441308 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:28.441308 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:28.441308 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:28.442487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:28.442487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:28.442487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:28.442487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:28.442487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:28.442487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:28.442487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:28.442487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:28.442487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:28.442487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:28.442487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:28.442487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:28.442487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:28.442487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:28.442487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:28.442487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:28.442487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:28.443587 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:28.443587 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:28.443587 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:28.443587 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:28.451442 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 290/596] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:39:28.452343 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:28.454169 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727885d-9667-4e0e-82e8-581acf8acfb6 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:28.504395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 307/597] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:39:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:39:28.510295 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25903aec-3634-49f1-9be9-b092d7983166 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:28.574817 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:28.589041 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4727885d-9667-4e0e-82e8-581acf8acfb6 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:28.629582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25903aec-3634-49f1-9be9-b092d7983166 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:28.629921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ea02a-e611-4db6-995e-cffb65aa05e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:28.630603 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ea02a-e611-4db6-995e-cffb65aa05e3 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:28.630886 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ea02a-e611-4db6-995e-cffb65aa05e3 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:28.631170 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ea02a-e611-4db6-995e-cffb65aa05e3 None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:28.631899 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ea02a-e611-4db6-995e-cffb65aa05e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:28.632213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ea02a-e611-4db6-995e-cffb65aa05e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:28.633653 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ea02a-e611-4db6-995e-cffb65aa05e3 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:28.648498 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 291/598] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:28.648498 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438ff5c-b6be-4b2d-8240-82240797fbbf None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:28.648498 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438ff5c-b6be-4b2d-8240-82240797fbbf None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:28.648498 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9438ff5c-b6be-4b2d-8240-82240797fbbf None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:28.652463 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 292/599] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:28.652463 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ea837-8235-4eae-9497-afe35dfe1273 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:28.652463 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ea837-8235-4eae-9497-afe35dfe1273 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:28.652463 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1ea837-8235-4eae-9497-afe35dfe1273 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:28.652791 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 293/600] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:28.653438 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ea837-8235-4eae-9497-afe35dfe1273 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:28.673892 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a260a67-8307-42e4-a44e-b8eee834fa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:28.674790 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a260a67-8307-42e4-a44e-b8eee834fa1e None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:28.675025 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a260a67-8307-42e4-a44e-b8eee834fa1e None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:28.675289 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a260a67-8307-42e4-a44e-b8eee834fa1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:28.686030 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a260a67-8307-42e4-a44e-b8eee834fa1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:28.687479 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a260a67-8307-42e4-a44e-b8eee834fa1e None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:28.706411 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-6a260a67-8307-42e4-a44e-b8eee834fa1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:28.706411 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:28.706411 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:28.706411 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:28.706411 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:28.706411 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:28.706411 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:28.706411 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:28.706411 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:28.706411 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:28.706411 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:28.706411 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:28.706411 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:28.706411 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:28.706411 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:28.707359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:28.707359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:28.707359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:28.707359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:28.707359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:28.707359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:28.707359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:28.707359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:28.707359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:28.707359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:28.707359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:28.707359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:28.707359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:28.707359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:28.707359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:28.707359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:28.707359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:28.708310 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:28.708310 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:28.708310 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:28.708310 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:28.708310 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 308/601] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:28.709402 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ece4f-eef4-420a-9f2e-d134c02522a9 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:28.709686 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ece4f-eef4-420a-9f2e-d134c02522a9 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:28.709959 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7ece4f-eef4-420a-9f2e-d134c02522a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:28.728901 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-7a7ece4f-eef4-420a-9f2e-d134c02522a9 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:28.729376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-7a7ece4f-eef4-420a-9f2e-d134c02522a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:28.744575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:28.768312 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1ea837-8235-4eae-9497-afe35dfe1273 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:28.799726 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157093af-8cc7-4d7e-b356-214d568c4cc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:28.800421 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 309/602] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:39:28.800721 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157093af-8cc7-4d7e-b356-214d568c4cc4 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:28.800854 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157093af-8cc7-4d7e-b356-214d568c4cc4 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:28.801157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157093af-8cc7-4d7e-b356-214d568c4cc4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:28.801722 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3c9dc-77fa-4e68-a93e-af13e4cfecc0 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:28.802045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3c9dc-77fa-4e68-a93e-af13e4cfecc0 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:28.802297 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3c9dc-77fa-4e68-a93e-af13e4cfecc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:28.810379 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157093af-8cc7-4d7e-b356-214d568c4cc4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:28.812143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157093af-8cc7-4d7e-b356-214d568c4cc4 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:28.819998 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-e3b3c9dc-77fa-4e68-a93e-af13e4cfecc0 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:28.821229 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-e3b3c9dc-77fa-4e68-a93e-af13e4cfecc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:28.827572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-157093af-8cc7-4d7e-b356-214d568c4cc4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 15:39:28.827572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:28.827572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:28.827572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:28.827572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:28.827572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:28.827572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:28.827572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:28.827572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:28.827572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:28.827572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:28.827572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:28.827572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:39:28.827572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:39:28.827572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:39:28.827572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:39:28.828849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:28.828849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:28.828849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:39:28.828849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:28.828849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:39:28.828849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:28.828849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:28.828849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:28.828849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:28.828849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:28.828849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:28.828849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:28.828849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:28.828849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:28.828849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:28.828849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:28.828849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:28.828849 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:28.829869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:28.829869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:28.829869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:39:28.829869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:39:28.829869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:39:28.829869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:39:28.829869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:39:28.829869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:39:28.829869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 15:39:28.829869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:28.832577 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 294/603] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:39:28 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:28.834085 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157093af-8cc7-4d7e-b356-214d568c4cc4 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:28.846623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:28.890294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 310/604] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:39:28.891147 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3c9dc-77fa-4e68-a93e-af13e4cfecc0 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:28.940698 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157093af-8cc7-4d7e-b356-214d568c4cc4 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:28.972821 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:28.975959 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffa2c1-f7a7-454c-b629-8e4b81902e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:28.976649 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffa2c1-f7a7-454c-b629-8e4b81902e84 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:28.976938 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffa2c1-f7a7-454c-b629-8e4b81902e84 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:28.977227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffa2c1-f7a7-454c-b629-8e4b81902e84 None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:28.977959 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffa2c1-f7a7-454c-b629-8e4b81902e84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:28.978268 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffa2c1-f7a7-454c-b629-8e4b81902e84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:28.979648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffa2c1-f7a7-454c-b629-8e4b81902e84 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:28.991628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 295/605] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:28.991807 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3c9dc-77fa-4e68-a93e-af13e4cfecc0 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:28.992461 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffa2c1-f7a7-454c-b629-8e4b81902e84 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:29.027656 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978e5ba-335d-484b-b503-00f0e66412a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:29.028367 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978e5ba-335d-484b-b503-00f0e66412a9 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:29.028674 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978e5ba-335d-484b-b503-00f0e66412a9 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:29.029058 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c978e5ba-335d-484b-b503-00f0e66412a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:29.039576 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c978e5ba-335d-484b-b503-00f0e66412a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:29.047618 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-c978e5ba-335d-484b-b503-00f0e66412a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:29.047618 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:29.047618 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:29.047618 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:29.047618 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:29.047618 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:29.047618 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:29.047618 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:29.047618 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:29.047618 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:29.047618 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:29.047618 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:29.047618 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:29.047618 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:29.047618 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:29.047618 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:29.049398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:29.049398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:29.049398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:29.049398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:29.049398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:29.049398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:29.049398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:29.049398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:29.049398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:29.049398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:29.049398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:29.049398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:29.049398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:29.049398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:29.049398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:29.049398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:29.050727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:29.050727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:29.050727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:29.050727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:29.050727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:29.050727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:29.050727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:29.050727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:29.050727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:29.050727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:29.050727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:29.050727 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:29.054325 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 311/606] 10.222.0.62 () {56 vars in 1102 bytes} [Wed May 25 15:39:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:29.054325 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978e5ba-335d-484b-b503-00f0e66412a9 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:29.065675 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:29.104734 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffa2c1-f7a7-454c-b629-8e4b81902e84 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:29.149633 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644410e-42af-4a2d-9a1b-aa7797f8dffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:29.150304 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644410e-42af-4a2d-9a1b-aa7797f8dffa None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:29.150586 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644410e-42af-4a2d-9a1b-aa7797f8dffa None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:29.150859 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644410e-42af-4a2d-9a1b-aa7797f8dffa None admin] PATH_INFO: `/v3/users` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:29.151685 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644410e-42af-4a2d-9a1b-aa7797f8dffa None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:29.151992 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644410e-42af-4a2d-9a1b-aa7797f8dffa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:29.153444 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8644410e-42af-4a2d-9a1b-aa7797f8dffa None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:29.161095 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c978e5ba-335d-484b-b503-00f0e66412a9 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:29.173198 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 296/607] 10.222.0.62 () {56 vars in 1137 bytes} [Wed May 25 15:39:28 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:29.174032 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644410e-42af-4a2d-9a1b-aa7797f8dffa None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:29.196262 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319613a8-945c-4954-b07a-ce4fa1ade42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:29.197085 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319613a8-945c-4954-b07a-ce4fa1ade42b None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:29.197367 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319613a8-945c-4954-b07a-ce4fa1ade42b None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:29.197639 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319613a8-945c-4954-b07a-ce4fa1ade42b None admin] PATH_INFO: `/v3/roles/service` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:29.205772 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:29.209141 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319613a8-945c-4954-b07a-ce4fa1ade42b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:29.216816 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-319613a8-945c-4954-b07a-ce4fa1ade42b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:29.216816 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:29.216816 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:29.216816 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:29.216816 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:29.216816 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:29.216816 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:29.216816 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:29.216816 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:29.216816 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:29.216816 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:29.216816 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:29.216816 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:29.216816 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:29.216816 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:29.216816 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:29.224376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:29.224376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:29.224376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:29.224376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:29.224376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:29.224376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:29.224376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:29.224376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:29.224376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:29.224376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:29.224376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:29.224376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:29.224376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:29.224376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:29.224376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:29.224376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:29.225274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:29.225274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:29.225274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:29.225274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:29.225274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:29.225274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:29.225274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:29.225274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:29.225274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:29.225274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:29.225274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:39:29.225274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:29.225274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 312/608] 10.222.0.62 () {56 vars in 1102 bytes} [Wed May 25 15:39:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:29.225274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319613a8-945c-4954-b07a-ce4fa1ade42b None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:29.277114 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644410e-42af-4a2d-9a1b-aa7797f8dffa None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:29.302405 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:29.310706 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c77c1-543a-4554-991b-f47f38852562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:29.312074 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c77c1-543a-4554-991b-f47f38852562 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:29.312350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c77c1-543a-4554-991b-f47f38852562 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:29.312736 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692c77c1-543a-4554-991b-f47f38852562 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:29.319203 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319613a8-945c-4954-b07a-ce4fa1ade42b None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:29.325659 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c77c1-543a-4554-991b-f47f38852562 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:29.325659 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692c77c1-543a-4554-991b-f47f38852562 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:29.334725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-692c77c1-543a-4554-991b-f47f38852562 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:29.334725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:29.334725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:29.334725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:29.334725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:29.334725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:29.334725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:29.334725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:29.334725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:29.334725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:29.334725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:29.334725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:29.334725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:39:29.334725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:39:29.334725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:39:29.335628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:39:29.335628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:29.335628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:29.335628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:29.335628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:29.335628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:29.335628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:29.335628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:29.335628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:29.335628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:29.335628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:29.335628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:29.335628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:29.335628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:29.335628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:29.335628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:29.335628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:29.336560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:39:29.336560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:39:29.336560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:39:29.336560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:39:29.336560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:39:29.336560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:39:29.336560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:29.336560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:29.336560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 297/609] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:29.337443 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c77c1-543a-4554-991b-f47f38852562 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:29.360884 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226aec1d-f33b-4aa8-af72-7bbda95662f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:29.361564 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aec1d-f33b-4aa8-af72-7bbda95662f9 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:29.361853 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aec1d-f33b-4aa8-af72-7bbda95662f9 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:29.362129 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226aec1d-f33b-4aa8-af72-7bbda95662f9 None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:29.362875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226aec1d-f33b-4aa8-af72-7bbda95662f9 None admin] RBAC: Adding query filter params (name=service) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:29.363202 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226aec1d-f33b-4aa8-af72-7bbda95662f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:29.364602 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226aec1d-f33b-4aa8-af72-7bbda95662f9 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:29.372737 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 313/610] 10.222.0.62 () {56 vars in 1103 bytes} [Wed May 25 15:39:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:29.374074 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226aec1d-f33b-4aa8-af72-7bbda95662f9 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:29.437482 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:29.445765 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692c77c1-543a-4554-991b-f47f38852562 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:29.476216 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226aec1d-f33b-4aa8-af72-7bbda95662f9 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:29.480631 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4255cc5-a916-4354-bed2-01bd24dd5acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:29.481283 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4255cc5-a916-4354-bed2-01bd24dd5acb None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:29.481572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4255cc5-a916-4354-bed2-01bd24dd5acb None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:29.481872 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4255cc5-a916-4354-bed2-01bd24dd5acb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:29.510793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff94f8b-3aef-4e0d-b782-ee87423f858f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:29.511457 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff94f8b-3aef-4e0d-b782-ee87423f858f None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:29.511743 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff94f8b-3aef-4e0d-b782-ee87423f858f None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:29.512015 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff94f8b-3aef-4e0d-b782-ee87423f858f None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:29.512797 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff94f8b-3aef-4e0d-b782-ee87423f858f None admin] RBAC: Adding query filter params (name=service) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:29.513102 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff94f8b-3aef-4e0d-b782-ee87423f858f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:29.514497 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff94f8b-3aef-4e0d-b782-ee87423f858f None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:29.522927 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 314/611] 10.222.0.62 () {56 vars in 1103 bytes} [Wed May 25 15:39:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:29.523750 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff94f8b-3aef-4e0d-b782-ee87423f858f None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:29.539236 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:29.553555 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4255cc5-a916-4354-bed2-01bd24dd5acb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:29.555281 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4255cc5-a916-4354-bed2-01bd24dd5acb None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:29.626405 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff94f8b-3aef-4e0d-b782-ee87423f858f None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:29.649682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:29.660750 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 298/612] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:39:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:39:29.661024 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde90be3-d25c-4942-81b7-2d4aa7ea2d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:29.661596 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4255cc5-a916-4354-bed2-01bd24dd5acb None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:29.661696 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde90be3-d25c-4942-81b7-2d4aa7ea2d03 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:29.661956 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde90be3-d25c-4942-81b7-2d4aa7ea2d03 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:29.662231 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde90be3-d25c-4942-81b7-2d4aa7ea2d03 None admin] PATH_INFO: `/v3/projects` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:29.663110 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde90be3-d25c-4942-81b7-2d4aa7ea2d03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:29.663413 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde90be3-d25c-4942-81b7-2d4aa7ea2d03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:29.664936 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde90be3-d25c-4942-81b7-2d4aa7ea2d03 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:29.678060 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 315/613] 10.222.0.62 () {56 vars in 1148 bytes} [Wed May 25 15:39:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:29.678898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde90be3-d25c-4942-81b7-2d4aa7ea2d03 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:29.748084 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:29.763923 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4255cc5-a916-4354-bed2-01bd24dd5acb None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:29.782957 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde90be3-d25c-4942-81b7-2d4aa7ea2d03 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:29.800321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae603a77-75bb-452b-b505-7257055016a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:29.801144 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae603a77-75bb-452b-b505-7257055016a8 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:29.801427 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae603a77-75bb-452b-b505-7257055016a8 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:29.801711 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae603a77-75bb-452b-b505-7257055016a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:29.812239 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae603a77-75bb-452b-b505-7257055016a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:29.813777 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae603a77-75bb-452b-b505-7257055016a8 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:29.817841 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97069c39-f769-448b-8369-7b13f92b2400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:29.818632 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97069c39-f769-448b-8369-7b13f92b2400 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:29.825481 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97069c39-f769-448b-8369-7b13f92b2400 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:29.825481 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97069c39-f769-448b-8369-7b13f92b2400 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:29.829887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97069c39-f769-448b-8369-7b13f92b2400 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:29.831305 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97069c39-f769-448b-8369-7b13f92b2400 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:29.833023 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-ae603a77-75bb-452b-b505-7257055016a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:29.833023 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:29.833023 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:29.833023 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:29.833023 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:29.833023 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:29.833023 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:29.833023 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:29.833023 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:29.833023 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:29.833023 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:29.833023 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:29.833023 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:29.833023 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:29.833023 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:29.833943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:29.833943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:29.833943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:29.833943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:29.833943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:29.833943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:29.833943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:29.833943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:29.833943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:29.833943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:29.833943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:29.833943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:29.833943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:29.833943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:29.833943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:29.833943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:29.833943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:29.835509 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:29.835509 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:29.835509 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:29.835509 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:29.835509 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 299/614] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:29.835509 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae603a77-75bb-452b-b505-7257055016a8 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:29.852280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-97069c39-f769-448b-8369-7b13f92b2400 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:29.852280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:29.852280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:29.852280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:29.852280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:29.852280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:29.852280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:29.852280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:29.852280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:29.852280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:29.852280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:29.852280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:29.852280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:29.852280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:29.852280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:29.853261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:29.853261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:29.853261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:29.853261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:29.853261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:29.853261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:29.853261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:29.853261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:29.853261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:29.853261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:29.853261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:29.853261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:29.853261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:29.853261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:29.853261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:29.853261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:29.853261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:29.854262 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:29.854262 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:29.854262 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:29.854262 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:29.854262 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 316/615] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:29.854913 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97069c39-f769-448b-8369-7b13f92b2400 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:29.890768 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:29.940039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae603a77-75bb-452b-b505-7257055016a8 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:29.957226 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97069c39-f769-448b-8369-7b13f92b2400 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:29.973412 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd93735-08c7-46f5-9397-4bcea91db0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:29.974205 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd93735-08c7-46f5-9397-4bcea91db0f4 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:29.974492 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd93735-08c7-46f5-9397-4bcea91db0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:29.974778 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd93735-08c7-46f5-9397-4bcea91db0f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:29.981259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:29.985751 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd93735-08c7-46f5-9397-4bcea91db0f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:29.987166 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd93735-08c7-46f5-9397-4bcea91db0f4 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:29.992608 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c042373-ec6a-40e3-bee8-e593b54a159c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:29.993261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c042373-ec6a-40e3-bee8-e593b54a159c None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:30.002752 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c042373-ec6a-40e3-bee8-e593b54a159c None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:30.002752 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c042373-ec6a-40e3-bee8-e593b54a159c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:30.002752 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c042373-ec6a-40e3-bee8-e593b54a159c None admin] RBAC: Adding query filter params (role.id=d1d28f6c8cb34e9f8af7cda9d128a351, scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5, user.id=d9b8b255e35c4949ba8faeb79921f141) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:30.002752 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c042373-ec6a-40e3-bee8-e593b54a159c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:30.002752 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c042373-ec6a-40e3-bee8-e593b54a159c None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:30.003227 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 317/616] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:39:29 2022] GET /identity/v3/role_assignments?user.id=d9b8b255e35c4949ba8faeb79921f141&scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5&role.id=d1d28f6c8cb34e9f8af7cda9d128a351 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:30.003968 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c042373-ec6a-40e3-bee8-e593b54a159c None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:30.005145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-3cd93735-08c7-46f5-9397-4bcea91db0f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:30.005145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:30.005145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:30.005145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:30.005145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:30.005145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:30.005145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:30.005145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:30.005145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:30.005145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:30.005145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:30.005145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:30.005145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:30.005145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:30.005145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:30.006255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:30.006255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:30.006255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:30.006255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:30.006255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:30.006255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:30.006255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:30.006255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:30.006255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:30.006255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:30.006255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:30.006255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:30.006255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:30.006255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:30.006255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:30.006255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:30.006255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:30.007158 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:30.007158 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:30.007158 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:30.007158 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:30.007158 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 300/617] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:30.007774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd93735-08c7-46f5-9397-4bcea91db0f4 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:30.124167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:30.127345 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c042373-ec6a-40e3-bee8-e593b54a159c None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:30.138450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd93735-08c7-46f5-9397-4bcea91db0f4 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:30.166133 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa18b65-9293-4466-b53c-858cd3aa3828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:30.166931 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa18b65-9293-4466-b53c-858cd3aa3828 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:30.167215 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa18b65-9293-4466-b53c-858cd3aa3828 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:30.167489 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa18b65-9293-4466-b53c-858cd3aa3828 None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:30.168301 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa18b65-9293-4466-b53c-858cd3aa3828 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:30.168647 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa18b65-9293-4466-b53c-858cd3aa3828 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:30.170052 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa18b65-9293-4466-b53c-858cd3aa3828 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:30.178466 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d288db-bfa9-4ea7-84d0-31abd7b11aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:30.179254 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d288db-bfa9-4ea7-84d0-31abd7b11aad None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:30.179535 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d288db-bfa9-4ea7-84d0-31abd7b11aad None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:30.179815 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d288db-bfa9-4ea7-84d0-31abd7b11aad None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:30.180610 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d288db-bfa9-4ea7-84d0-31abd7b11aad None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:30.180924 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d288db-bfa9-4ea7-84d0-31abd7b11aad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:30.182320 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d288db-bfa9-4ea7-84d0-31abd7b11aad None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:30.184934 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 318/618] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:30.186419 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa18b65-9293-4466-b53c-858cd3aa3828 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:30.203798 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 301/619] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:30.205147 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d288db-bfa9-4ea7-84d0-31abd7b11aad None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:30.264128 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:30.313312 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa18b65-9293-4466-b53c-858cd3aa3828 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:30.315514 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d288db-bfa9-4ea7-84d0-31abd7b11aad None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:30.350659 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439189b-b494-427e-89db-8eac54084cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:30.351341 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439189b-b494-427e-89db-8eac54084cc3 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:30.351629 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439189b-b494-427e-89db-8eac54084cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:30.351908 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3439189b-b494-427e-89db-8eac54084cc3 None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:30.352667 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439189b-b494-427e-89db-8eac54084cc3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:30.352975 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439189b-b494-427e-89db-8eac54084cc3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:30.354350 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3439189b-b494-427e-89db-8eac54084cc3 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:30.358399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97461e9e-3ada-492a-a575-757b10ad61df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:30.359535 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97461e9e-3ada-492a-a575-757b10ad61df None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:30.360017 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97461e9e-3ada-492a-a575-757b10ad61df None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:30.360512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97461e9e-3ada-492a-a575-757b10ad61df None admin] PATH_INFO: `/v3/users/neutron` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:30.366620 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 319/620] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:30.367468 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439189b-b494-427e-89db-8eac54084cc3 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:30.372270 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97461e9e-3ada-492a-a575-757b10ad61df None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:30.374420 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97461e9e-3ada-492a-a575-757b10ad61df None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:30.389651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-97461e9e-3ada-492a-a575-757b10ad61df None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 15:39:30.389651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:30.389651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:30.389651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:30.389651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:30.389651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:30.389651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:30.389651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:30.389651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:30.389651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:30.389651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:30.389651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:30.389651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:39:30.389651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:39:30.389651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:39:30.389651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:39:30.390906 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:30.390906 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:30.390906 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:39:30.390906 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:30.390906 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:39:30.390906 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:30.390906 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:30.390906 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:30.390906 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:30.390906 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:30.390906 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:30.390906 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:30.390906 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:30.390906 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:30.390906 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:30.390906 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:30.390906 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:30.390906 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:30.391858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:30.391858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:30.391858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:39:30.391858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:39:30.391858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:39:30.391858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:39:30.391858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:39:30.391858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:39:30.391858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 15:39:30.391858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:30.391858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 302/621] 10.222.0.62 () {56 vars in 1102 bytes} [Wed May 25 15:39:30 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:30.391858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97461e9e-3ada-492a-a575-757b10ad61df None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:30.400788 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:30.486434 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3439189b-b494-427e-89db-8eac54084cc3 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:30.507154 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97461e9e-3ada-492a-a575-757b10ad61df None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:30.518431 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:30.526420 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714df872-2b9a-49a4-8932-6c876ffa3c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:30.527343 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714df872-2b9a-49a4-8932-6c876ffa3c16 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:30.527623 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714df872-2b9a-49a4-8932-6c876ffa3c16 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:30.527892 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714df872-2b9a-49a4-8932-6c876ffa3c16 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:30.537217 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714df872-2b9a-49a4-8932-6c876ffa3c16 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:30.538669 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714df872-2b9a-49a4-8932-6c876ffa3c16 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:30.542668 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c827b98-bd63-480b-99dc-495e22314e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:30.543557 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c827b98-bd63-480b-99dc-495e22314e44 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:30.543847 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c827b98-bd63-480b-99dc-495e22314e44 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:30.544127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c827b98-bd63-480b-99dc-495e22314e44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:30.551686 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c827b98-bd63-480b-99dc-495e22314e44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:30.553165 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c827b98-bd63-480b-99dc-495e22314e44 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:30.554383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-714df872-2b9a-49a4-8932-6c876ffa3c16 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:39:30.554383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:30.554383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:30.554383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:30.554383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:30.554383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:30.554383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:30.554383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:30.554383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:30.554383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:30.554383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:30.554383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:30.554383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:39:30.554383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:39:30.554383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:39:30.554383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:39:30.555585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:30.555585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:30.555585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:39:30.555585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:30.555585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:39:30.555585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:30.555585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:30.555585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:30.555585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:30.555585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:30.555585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:30.555585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:30.555585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:30.555585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:30.555585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:30.555585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:30.555585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:30.555585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:30.556605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:30.556605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:30.556605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:39:30.556605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:39:30.556605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:39:30.556605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:39:30.556605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:39:30.556605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:39:30.556605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:39:30.556605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:30.560220 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 320/622] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:39:30 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:30.561186 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714df872-2b9a-49a4-8932-6c876ffa3c16 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:30.571225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-0c827b98-bd63-480b-99dc-495e22314e44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:30.571225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:30.571225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:30.571225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:30.571225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:30.571225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:30.571225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:30.571225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:30.571225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:30.571225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:30.571225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:30.571225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:30.571225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:39:30.571225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:39:30.571225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:39:30.572174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:39:30.572174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:30.572174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:30.572174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:30.572174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:30.572174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:30.572174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:30.572174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:30.572174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:30.572174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:30.572174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:30.572174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:30.572174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:30.572174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:30.572174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:30.572174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:30.572174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:30.578596 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:39:30.578596 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:39:30.578596 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:39:30.578596 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:39:30.578596 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:39:30.578596 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:39:30.578596 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:30.578596 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:30.578596 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 303/623] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:30.578596 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c827b98-bd63-480b-99dc-495e22314e44 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:30.661943 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:30.682684 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c827b98-bd63-480b-99dc-495e22314e44 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:30.683023 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714df872-2b9a-49a4-8932-6c876ffa3c16 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:30.718015 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5571cc-d674-4c23-9e52-6c949b60d724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:30.718784 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5571cc-d674-4c23-9e52-6c949b60d724 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:30.719144 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5571cc-d674-4c23-9e52-6c949b60d724 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:30.719493 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5571cc-d674-4c23-9e52-6c949b60d724 None admin] PATH_INFO: `/v3/users` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:30.720136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acf437-a525-447c-9889-d5f783153c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:30.720538 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5571cc-d674-4c23-9e52-6c949b60d724 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:30.732335 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5571cc-d674-4c23-9e52-6c949b60d724 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:30.732503 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acf437-a525-447c-9889-d5f783153c03 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:30.732503 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acf437-a525-447c-9889-d5f783153c03 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:30.732503 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87acf437-a525-447c-9889-d5f783153c03 None admin] PATH_INFO: `/v3/users` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:30.732730 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5571cc-d674-4c23-9e52-6c949b60d724 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:30.733317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acf437-a525-447c-9889-d5f783153c03 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:30.733317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acf437-a525-447c-9889-d5f783153c03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:30.733317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87acf437-a525-447c-9889-d5f783153c03 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:30.740671 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 304/624] 10.222.0.62 () {56 vars in 1137 bytes} [Wed May 25 15:39:30 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:30.741419 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5571cc-d674-4c23-9e52-6c949b60d724 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:30.754222 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 321/625] 10.222.0.62 () {56 vars in 1139 bytes} [Wed May 25 15:39:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:30.754222 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acf437-a525-447c-9889-d5f783153c03 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:30.777550 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:30.858062 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5571cc-d674-4c23-9e52-6c949b60d724 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:30.868579 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87acf437-a525-447c-9889-d5f783153c03 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:30.897224 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d7706-587c-45ea-ba01-5e66fa1c6584 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:30.898254 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d7706-587c-45ea-ba01-5e66fa1c6584 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:30.898722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d7706-587c-45ea-ba01-5e66fa1c6584 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:30.899181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d7706-587c-45ea-ba01-5e66fa1c6584 None admin] PATH_INFO: `/v3/projects` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:30.900145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d7706-587c-45ea-ba01-5e66fa1c6584 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:30.900698 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d7706-587c-45ea-ba01-5e66fa1c6584 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:30.902196 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d7706-587c-45ea-ba01-5e66fa1c6584 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:30.906061 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619b4b9-7e1c-4a76-a080-481ec391d8b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:30.906723 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619b4b9-7e1c-4a76-a080-481ec391d8b5 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:30.907012 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619b4b9-7e1c-4a76-a080-481ec391d8b5 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:30.907290 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6619b4b9-7e1c-4a76-a080-481ec391d8b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:30.919707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 305/626] 10.222.0.62 () {56 vars in 1148 bytes} [Wed May 25 15:39:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:30.919707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d7706-587c-45ea-ba01-5e66fa1c6584 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:30.923790 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:30.993915 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619b4b9-7e1c-4a76-a080-481ec391d8b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:30.995387 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6619b4b9-7e1c-4a76-a080-481ec391d8b5 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:31.012384 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:31.025852 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d7706-587c-45ea-ba01-5e66fa1c6584 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:31.060087 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1d4a6-c089-43eb-b619-3e471d4edaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:31.060768 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1d4a6-c089-43eb-b619-3e471d4edaa6 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:31.061585 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1d4a6-c089-43eb-b619-3e471d4edaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:31.061868 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a1d4a6-c089-43eb-b619-3e471d4edaa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:31.119609 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 322/627] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:39:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:39:31.119609 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619b4b9-7e1c-4a76-a080-481ec391d8b5 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:31.136178 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1d4a6-c089-43eb-b619-3e471d4edaa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:31.137582 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a1d4a6-c089-43eb-b619-3e471d4edaa6 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:31.165505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:31.233976 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6619b4b9-7e1c-4a76-a080-481ec391d8b5 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:31.239630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:31.259151 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 306/628] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:39:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:39:31.259151 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1d4a6-c089-43eb-b619-3e471d4edaa6 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:31.277669 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063c68a-4126-44c3-8ee6-1fb6ccc25d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:31.278364 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063c68a-4126-44c3-8ee6-1fb6ccc25d19 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:31.278627 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063c68a-4126-44c3-8ee6-1fb6ccc25d19 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:31.278912 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8063c68a-4126-44c3-8ee6-1fb6ccc25d19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:31.279883 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063c68a-4126-44c3-8ee6-1fb6ccc25d19 None admin] RBAC: Adding query filter params (role.id=d1d28f6c8cb34e9f8af7cda9d128a351, scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5, user.id=530c527ef42e4f949b15c74206baf99b) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:31.280200 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063c68a-4126-44c3-8ee6-1fb6ccc25d19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:31.281900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8063c68a-4126-44c3-8ee6-1fb6ccc25d19 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:31.300459 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 323/629] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:39:31 2022] GET /identity/v3/role_assignments?user.id=530c527ef42e4f949b15c74206baf99b&scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5&role.id=d1d28f6c8cb34e9f8af7cda9d128a351 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:31.300459 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063c68a-4126-44c3-8ee6-1fb6ccc25d19 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:31.401940 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a1d4a6-c089-43eb-b619-3e471d4edaa6 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:31.424706 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8063c68a-4126-44c3-8ee6-1fb6ccc25d19 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:31.426440 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:31.457943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2e3c5-1195-4b22-be53-74ba2ccd75c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:31.459581 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2e3c5-1195-4b22-be53-74ba2ccd75c4 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:31.460075 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2e3c5-1195-4b22-be53-74ba2ccd75c4 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:31.460530 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2e3c5-1195-4b22-be53-74ba2ccd75c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:31.474323 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2e3c5-1195-4b22-be53-74ba2ccd75c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:31.476356 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db2e3c5-1195-4b22-be53-74ba2ccd75c4 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:31.477849 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502c1b7-d380-4f9d-95b4-74c2a299c3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:31.479114 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502c1b7-d380-4f9d-95b4-74c2a299c3fa None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:31.479499 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502c1b7-d380-4f9d-95b4-74c2a299c3fa None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:31.479871 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2502c1b7-d380-4f9d-95b4-74c2a299c3fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:31.495762 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502c1b7-d380-4f9d-95b4-74c2a299c3fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:31.497199 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2502c1b7-d380-4f9d-95b4-74c2a299c3fa None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:31.501286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-7db2e3c5-1195-4b22-be53-74ba2ccd75c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:31.501286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:31.501286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:31.501286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:31.501286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:31.501286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:31.501286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:31.501286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:31.501286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:31.501286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:31.501286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:31.501286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:31.501286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:31.501286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:31.501286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:31.502227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:31.502227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:31.502227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:31.502227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:31.502227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:31.502227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:31.502227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:31.502227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:31.502227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:31.502227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:31.502227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:31.502227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:31.502227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:31.502227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:31.502227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:31.502227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:31.502227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:31.507989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:31.507989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:31.507989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:31.507989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:31.507989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 307/630] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:31.511016 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2e3c5-1195-4b22-be53-74ba2ccd75c4 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:31.520774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-2502c1b7-d380-4f9d-95b4-74c2a299c3fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:31.520774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:31.520774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:31.520774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:31.520774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:31.520774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:31.520774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:31.520774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:31.520774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:31.520774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:31.520774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:31.520774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:31.520774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:31.520774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:31.520774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:31.521716 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:31.521716 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:31.521716 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:31.521716 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:31.521716 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:31.521716 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:31.521716 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:31.521716 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:31.521716 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:31.521716 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:31.521716 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:31.521716 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:31.521716 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:31.521716 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:31.521716 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:31.521716 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:31.521716 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:31.523012 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:31.523012 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:31.523012 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:31.523012 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:31.523012 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 324/631] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:31.529433 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502c1b7-d380-4f9d-95b4-74c2a299c3fa None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:31.574392 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:31.650878 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db2e3c5-1195-4b22-be53-74ba2ccd75c4 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:31.668277 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2502c1b7-d380-4f9d-95b4-74c2a299c3fa None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:31.696965 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abddaa-3859-4c62-8e17-146f84b0324f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:31.697802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abddaa-3859-4c62-8e17-146f84b0324f None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:31.698205 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abddaa-3859-4c62-8e17-146f84b0324f None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:31.698499 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8abddaa-3859-4c62-8e17-146f84b0324f None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:31.699225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abddaa-3859-4c62-8e17-146f84b0324f None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:31.699532 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abddaa-3859-4c62-8e17-146f84b0324f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:31.701802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8abddaa-3859-4c62-8e17-146f84b0324f None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:31.715287 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4c52d-cb60-4976-9424-28e22fc3a40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:31.716560 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4c52d-cb60-4976-9424-28e22fc3a40c None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:31.717058 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4c52d-cb60-4976-9424-28e22fc3a40c None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:31.718041 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df4c52d-cb60-4976-9424-28e22fc3a40c None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:31.719075 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 308/632] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:31.719401 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4c52d-cb60-4976-9424-28e22fc3a40c None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:31.719717 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4c52d-cb60-4976-9424-28e22fc3a40c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:31.724652 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df4c52d-cb60-4976-9424-28e22fc3a40c None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:31.724786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abddaa-3859-4c62-8e17-146f84b0324f None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:31.739540 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 325/633] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:31.745746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4c52d-cb60-4976-9424-28e22fc3a40c None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:31.767968 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:31.856347 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:31.860272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8abddaa-3859-4c62-8e17-146f84b0324f None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:31.887092 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df4c52d-cb60-4976-9424-28e22fc3a40c None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:31.899212 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c3135-eeb3-4e4f-953f-256c315a042d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:31.900305 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c3135-eeb3-4e4f-953f-256c315a042d None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:31.900587 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c3135-eeb3-4e4f-953f-256c315a042d None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:31.900957 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2c3135-eeb3-4e4f-953f-256c315a042d None admin] PATH_INFO: `/v3/projects/service` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:31.910050 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c3135-eeb3-4e4f-953f-256c315a042d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:31.911683 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2c3135-eeb3-4e4f-953f-256c315a042d None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:31.927274 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-ce2c3135-eeb3-4e4f-953f-256c315a042d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:31.927274 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:31.927274 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:31.927274 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:31.927274 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:31.927274 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:31.927274 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:31.927274 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:31.927274 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:31.927274 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:31.927274 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:31.927274 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:31.927274 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:39:31.927274 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:39:31.927274 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:39:31.928479 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:39:31.928479 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:31.928479 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:31.928479 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:31.928479 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:31.928479 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:31.928479 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:31.928479 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:31.928479 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:31.928479 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:31.928479 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:31.928479 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:31.928479 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:31.928479 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:31.928479 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:31.928479 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:31.928479 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:31.929592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:39:31.929592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:39:31.929592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:39:31.929592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:39:31.929592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:39:31.929592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:39:31.929592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:31.929592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:31.934802 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66f27e-b981-41af-8222-ccbb1a1d76fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:31.935832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 309/634] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:39:31.936834 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66f27e-b981-41af-8222-ccbb1a1d76fc None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:31.937049 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c3135-eeb3-4e4f-953f-256c315a042d None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:31.937427 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66f27e-b981-41af-8222-ccbb1a1d76fc None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:31.937849 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f66f27e-b981-41af-8222-ccbb1a1d76fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:31.947123 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66f27e-b981-41af-8222-ccbb1a1d76fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:31.948879 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f66f27e-b981-41af-8222-ccbb1a1d76fc None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:31.966882 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-2f66f27e-b981-41af-8222-ccbb1a1d76fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:31.966882 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:31.966882 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:31.966882 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:31.966882 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:31.966882 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:31.966882 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:31.966882 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:31.966882 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:31.966882 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:31.966882 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:31.966882 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:31.966882 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:39:31.966882 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:39:31.966882 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:39:31.968488 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:39:31.968488 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:31.968488 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:31.968488 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:31.968488 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:31.968488 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:31.968488 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:31.968488 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:31.968488 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:31.968488 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:31.968488 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:31.968488 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:31.968488 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:31.968488 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:31.968488 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:31.968488 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:31.968488 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:31.969511 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:39:31.969511 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:39:31.969511 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:39:31.969511 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:39:31.969511 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:39:31.969511 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:39:31.969511 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:31.969511 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:31.972907 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 326/635] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:39:31.975427 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66f27e-b981-41af-8222-ccbb1a1d76fc None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:32.059164 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:32.064916 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2c3135-eeb3-4e4f-953f-256c315a042d None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:32.091548 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f66f27e-b981-41af-8222-ccbb1a1d76fc None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:32.102763 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c87d9-1360-43e4-a34d-0ba1ea03894f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:32.103769 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c87d9-1360-43e4-a34d-0ba1ea03894f None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:32.104229 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c87d9-1360-43e4-a34d-0ba1ea03894f None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:32.104718 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645c87d9-1360-43e4-a34d-0ba1ea03894f None admin] PATH_INFO: `/v3/projects` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:32.105915 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c87d9-1360-43e4-a34d-0ba1ea03894f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:32.106440 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c87d9-1360-43e4-a34d-0ba1ea03894f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:32.108742 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645c87d9-1360-43e4-a34d-0ba1ea03894f None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:32.124634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 310/636] 10.222.0.62 () {56 vars in 1148 bytes} [Wed May 25 15:39:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:32.136355 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c87d9-1360-43e4-a34d-0ba1ea03894f None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:32.150147 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79406dae-3484-494d-906d-f05366020ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:32.150819 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79406dae-3484-494d-906d-f05366020ca0 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:32.151110 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79406dae-3484-494d-906d-f05366020ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:32.151391 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79406dae-3484-494d-906d-f05366020ca0 None admin] PATH_INFO: `/v3/projects` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:32.152181 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79406dae-3484-494d-906d-f05366020ca0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:32.152517 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79406dae-3484-494d-906d-f05366020ca0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:32.154692 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79406dae-3484-494d-906d-f05366020ca0 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:32.166681 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:32.175061 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 327/637] 10.222.0.62 () {56 vars in 1148 bytes} [Wed May 25 15:39:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:32.177296 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79406dae-3484-494d-906d-f05366020ca0 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:32.261344 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645c87d9-1360-43e4-a34d-0ba1ea03894f None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:32.308855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6bad56-38e4-44b1-87b8-19dedf15d9d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:32.310150 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bad56-38e4-44b1-87b8-19dedf15d9d8 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:32.310829 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bad56-38e4-44b1-87b8-19dedf15d9d8 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:32.311803 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6bad56-38e4-44b1-87b8-19dedf15d9d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:32.313502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bad56-38e4-44b1-87b8-19dedf15d9d8 None admin] RBAC: Adding query filter params (role.id=d1d28f6c8cb34e9f8af7cda9d128a351, scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5, user.id=45fabc3594f64571a0b381990b7974f8) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:32.313990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bad56-38e4-44b1-87b8-19dedf15d9d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:32.315448 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79406dae-3484-494d-906d-f05366020ca0 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:32.315787 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6bad56-38e4-44b1-87b8-19dedf15d9d8 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:32.329014 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 311/638] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:39:32 2022] GET /identity/v3/role_assignments?user.id=45fabc3594f64571a0b381990b7974f8&scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5&role.id=d1d28f6c8cb34e9f8af7cda9d128a351 => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:32.362465 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423ffaa1-b990-4297-86fe-b0e5ac8a08b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:32.363147 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ffaa1-b990-4297-86fe-b0e5ac8a08b3 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:32.363434 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ffaa1-b990-4297-86fe-b0e5ac8a08b3 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:32.363711 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423ffaa1-b990-4297-86fe-b0e5ac8a08b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:32.364596 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ffaa1-b990-4297-86fe-b0e5ac8a08b3 None admin] RBAC: Adding query filter params (role.id=d1d28f6c8cb34e9f8af7cda9d128a351, scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5, user.id=d1cb7a1be78c4b55b5ec991b99d47020) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:32.364911 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ffaa1-b990-4297-86fe-b0e5ac8a08b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:32.366400 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423ffaa1-b990-4297-86fe-b0e5ac8a08b3 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:32.369177 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:32.375492 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 328/639] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:39:32 2022] GET /identity/v3/role_assignments?user.id=d1cb7a1be78c4b55b5ec991b99d47020&scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5&role.id=d1d28f6c8cb34e9f8af7cda9d128a351 => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:32.436555 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3ef76-4e01-41b7-b905-a9eb2371a91b None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:32.436893 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3ef76-4e01-41b7-b905-a9eb2371a91b None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:32.437117 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3ef76-4e01-41b7-b905-a9eb2371a91b None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:32.439078 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 312/640] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:32.445028 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c8a89-7716-4893-9b84-380728ec665e None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:32.445465 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c8a89-7716-4893-9b84-380728ec665e None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:32.445845 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5c8a89-7716-4893-9b84-380728ec665e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:32.466106 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-1f5c8a89-7716-4893-9b84-380728ec665e None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:32.467399 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-1f5c8a89-7716-4893-9b84-380728ec665e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:32.552817 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 329/641] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:39:32.579309 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3ef76-4e01-41b7-b905-a9eb2371a91b None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:32.688291 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:32.706059 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3ef76-4e01-41b7-b905-a9eb2371a91b None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:32.747403 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c0831-6875-4869-ae0d-f82073f6bf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:32.749003 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c0831-6875-4869-ae0d-f82073f6bf53 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:32.749503 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c0831-6875-4869-ae0d-f82073f6bf53 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:32.750011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c0831-6875-4869-ae0d-f82073f6bf53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:32.761456 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c0831-6875-4869-ae0d-f82073f6bf53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:32.770311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-8a4c0831-6875-4869-ae0d-f82073f6bf53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:39:32.770311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:32.770311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:32.770311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:32.770311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:32.770311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:32.770311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:32.770311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:32.770311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:32.770311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:32.770311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:32.770311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:32.770311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:32.770311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:32.770311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:32.770311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:32.771364 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:32.771364 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:32.771364 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:32.771364 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:32.771364 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:32.771364 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:32.771364 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:32.771364 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:32.771364 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:32.771364 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:32.771364 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:32.771364 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:32.771364 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:32.771364 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:32.771364 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:32.771364 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:32.772267 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:32.772267 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:32.772267 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:32.772267 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:32.772267 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:32.772267 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:32.772267 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:32.772267 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:32.772267 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:32.772267 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:32.772267 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:39:32.772267 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:32.775086 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 313/642] 10.222.0.62 () {56 vars in 1096 bytes} [Wed May 25 15:39:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:32.784462 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c8a89-7716-4893-9b84-380728ec665e None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:32.890560 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5c8a89-7716-4893-9b84-380728ec665e None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:32.919119 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:32.927151 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffa591-fe0e-4562-b5b1-90e826baa5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:32.927823 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffa591-fe0e-4562-b5b1-90e826baa5da None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:32.928103 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffa591-fe0e-4562-b5b1-90e826baa5da None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:32.930372 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bffa591-fe0e-4562-b5b1-90e826baa5da None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:32.930372 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffa591-fe0e-4562-b5b1-90e826baa5da None admin] RBAC: Adding query filter params (name=admin) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:32.930372 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffa591-fe0e-4562-b5b1-90e826baa5da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:32.930786 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bffa591-fe0e-4562-b5b1-90e826baa5da None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:32.939741 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 330/643] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:39:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:32.945513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c0831-6875-4869-ae0d-f82073f6bf53 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:33.065147 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c0831-6875-4869-ae0d-f82073f6bf53 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:33.105338 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2198c15-428b-479f-9a7c-3cf76569b461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:33.106501 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2198c15-428b-479f-9a7c-3cf76569b461 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:33.107013 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2198c15-428b-479f-9a7c-3cf76569b461 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:33.107503 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2198c15-428b-479f-9a7c-3cf76569b461 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:33.121458 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2198c15-428b-479f-9a7c-3cf76569b461 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:33.123208 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2198c15-428b-479f-9a7c-3cf76569b461 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:33.126341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:33.142127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-b2198c15-428b-479f-9a7c-3cf76569b461 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:33.142127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:33.142127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:33.142127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:33.142127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:33.142127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:33.142127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:33.142127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:33.142127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:33.142127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:33.142127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:33.142127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:33.142127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:33.142127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:33.142127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:33.143022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:33.143022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:33.143022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:33.143022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:33.143022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:33.143022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:33.143022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:33.143022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:33.143022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:33.143022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:33.143022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:33.143022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:33.143022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:33.143022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:33.143022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:33.143022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:33.143022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:33.143925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:33.143925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:33.143925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:33.143925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:33.143925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 314/644] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:33.149065 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffa591-fe0e-4562-b5b1-90e826baa5da None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:33.267664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bffa591-fe0e-4562-b5b1-90e826baa5da None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:33.303932 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96c6a3-f4d4-478b-8e2c-d005b2fa7273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:33.304639 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96c6a3-f4d4-478b-8e2c-d005b2fa7273 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:33.304919 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96c6a3-f4d4-478b-8e2c-d005b2fa7273 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:33.305190 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd96c6a3-f4d4-478b-8e2c-d005b2fa7273 None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:33.305908 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96c6a3-f4d4-478b-8e2c-d005b2fa7273 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:33.306206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96c6a3-f4d4-478b-8e2c-d005b2fa7273 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:33.307846 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd96c6a3-f4d4-478b-8e2c-d005b2fa7273 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:33.322230 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 331/645] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:33.328561 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2198c15-428b-479f-9a7c-3cf76569b461 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:33.437220 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2198c15-428b-479f-9a7c-3cf76569b461 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:33.475473 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996504a4-dca6-40c6-9f18-0e8f4f76e7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:33.476720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996504a4-dca6-40c6-9f18-0e8f4f76e7ca None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:33.477204 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996504a4-dca6-40c6-9f18-0e8f4f76e7ca None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:33.477673 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996504a4-dca6-40c6-9f18-0e8f4f76e7ca None admin] PATH_INFO: `/v3/users/nova` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:33.486298 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996504a4-dca6-40c6-9f18-0e8f4f76e7ca None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:33.487990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996504a4-dca6-40c6-9f18-0e8f4f76e7ca None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:33.503525 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-996504a4-dca6-40c6-9f18-0e8f4f76e7ca None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 15:39:33.503525 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:33.503525 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:33.503525 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:33.503525 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:33.503525 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:33.503525 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:33.503525 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:33.503525 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:33.503525 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:33.503525 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:33.503525 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:33.503525 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:39:33.503525 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:39:33.503525 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:39:33.503525 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:39:33.508674 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:33.508674 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:33.508674 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:39:33.508674 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:33.508674 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:39:33.508674 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:33.508674 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:33.508674 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:33.508674 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:33.508674 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:33.508674 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:33.508674 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:33.508674 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:33.508674 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:33.508674 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:33.508674 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:33.508674 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:33.508674 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:33.509717 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:33.509717 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:33.509717 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:39:33.509717 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:39:33.509717 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:39:33.509717 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:39:33.509717 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:39:33.509717 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:39:33.509717 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 15:39:33.509717 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:33.509717 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 315/646] 10.222.0.62 () {56 vars in 1093 bytes} [Wed May 25 15:39:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:33.513500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96c6a3-f4d4-478b-8e2c-d005b2fa7273 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:33.571685 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:33.629899 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd96c6a3-f4d4-478b-8e2c-d005b2fa7273 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:33.669895 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1987936-4d60-4c8a-9e19-27767bd10756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:33.671274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1987936-4d60-4c8a-9e19-27767bd10756 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:33.671556 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1987936-4d60-4c8a-9e19-27767bd10756 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:33.671827 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1987936-4d60-4c8a-9e19-27767bd10756 None admin] PATH_INFO: `/v3/users` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:33.672787 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1987936-4d60-4c8a-9e19-27767bd10756 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:33.673158 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1987936-4d60-4c8a-9e19-27767bd10756 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:33.674600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1987936-4d60-4c8a-9e19-27767bd10756 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:33.696009 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 332/647] 10.222.0.62 () {56 vars in 1133 bytes} [Wed May 25 15:39:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:33.705549 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996504a4-dca6-40c6-9f18-0e8f4f76e7ca None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:33.768218 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:33.809792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005a002-d4a4-4659-896a-3e64f3d91776 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:33.810122 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005a002-d4a4-4659-896a-3e64f3d91776 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:33.810358 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7005a002-d4a4-4659-896a-3e64f3d91776 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:33.813767 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 333/648] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:39:33.818201 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710e4a2-cd7d-4fc5-922b-f106cdc5fe37 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:33.818487 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710e4a2-cd7d-4fc5-922b-f106cdc5fe37 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:33.818765 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3710e4a2-cd7d-4fc5-922b-f106cdc5fe37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:33.820874 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996504a4-dca6-40c6-9f18-0e8f4f76e7ca None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:33.835688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-3710e4a2-cd7d-4fc5-922b-f106cdc5fe37 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:33.836998 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-3710e4a2-cd7d-4fc5-922b-f106cdc5fe37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:33.856701 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba1697-bb95-4857-a826-7ffb0571859c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:33.857392 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba1697-bb95-4857-a826-7ffb0571859c None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:33.857678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba1697-bb95-4857-a826-7ffb0571859c None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:33.858497 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fba1697-bb95-4857-a826-7ffb0571859c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:33.920673 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 334/649] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:39:33.929616 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba1697-bb95-4857-a826-7ffb0571859c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:33.931077 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fba1697-bb95-4857-a826-7ffb0571859c None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:33.937353 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710e4a2-cd7d-4fc5-922b-f106cdc5fe37 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:33.985778 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:33.996018 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:34.048709 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 316/650] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:39:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 15:39:34.053695 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba1697-bb95-4857-a826-7ffb0571859c None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:34.069747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3710e4a2-cd7d-4fc5-922b-f106cdc5fe37 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:34.112979 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38695e5-632a-4196-b580-abcd3dd22dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:34.114520 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38695e5-632a-4196-b580-abcd3dd22dc9 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:34.115242 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38695e5-632a-4196-b580-abcd3dd22dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:34.115661 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38695e5-632a-4196-b580-abcd3dd22dc9 None admin] PATH_INFO: `/v3/services/image` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:34.116632 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38695e5-632a-4196-b580-abcd3dd22dc9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:34.118725 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38695e5-632a-4196-b580-abcd3dd22dc9 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:34.141292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-a38695e5-632a-4196-b580-abcd3dd22dc9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:39:34.141292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:34.141292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:39:34.141292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:39:34.141292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:39:34.141292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:39:34.141292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:39:34.141292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:34.141292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:39:34.141292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:34.141292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:39:34.141292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:34.141292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:34.141292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:34.141292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:34.141292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:34.141292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:34.142438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:34.142438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:34.142438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:34.142438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:34.142438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:34.142438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:34.142438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:39:34.142438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:39:34.142438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:39:34.142438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:39:34.142438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:34.142438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:34.142438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:34.142438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:34.142438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:34.142438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:34.143267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:34.143267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:34.143267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:34.143267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:34.143267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:34.143267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:34.143267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:34.143267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:34.143267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:34.143267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:34.143267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:39:34.143267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:34.143267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:39:34.143267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:34.146693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 335/651] 10.222.0.62 () {56 vars in 1105 bytes} [Wed May 25 15:39:33 2022] GET /identity/v3/services/image => generated 86 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:34.157565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38695e5-632a-4196-b580-abcd3dd22dc9 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:34.173916 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fba1697-bb95-4857-a826-7ffb0571859c None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:34.216439 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0123acc-ea5f-41ed-abdd-87bec1ffffe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:34.217374 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0123acc-ea5f-41ed-abdd-87bec1ffffe5 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:34.217726 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0123acc-ea5f-41ed-abdd-87bec1ffffe5 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:34.218072 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0123acc-ea5f-41ed-abdd-87bec1ffffe5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:34.229533 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0123acc-ea5f-41ed-abdd-87bec1ffffe5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:34.231248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0123acc-ea5f-41ed-abdd-87bec1ffffe5 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:34.251769 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-a0123acc-ea5f-41ed-abdd-87bec1ffffe5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:34.251769 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:34.251769 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:34.251769 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:34.251769 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:34.251769 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:34.251769 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:34.251769 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:34.251769 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:34.251769 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:34.251769 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:34.251769 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:34.251769 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:34.251769 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:34.251769 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:34.252720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:34.252720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:34.252720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:34.252720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:34.252720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:34.252720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:34.252720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:34.252720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:34.252720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:34.252720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:34.252720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:34.252720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:34.252720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:34.252720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:34.252720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:34.252720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:34.252720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:34.253633 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:34.253633 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:34.253633 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:34.253633 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:34.253633 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 317/652] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:39:34.259860 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0123acc-ea5f-41ed-abdd-87bec1ffffe5 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:34.275465 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:34.281469 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38695e5-632a-4196-b580-abcd3dd22dc9 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:34.283467 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:34.320228 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafcae6-c3fb-4ee7-a72d-02d9d8a6cb10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:34.321348 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafcae6-c3fb-4ee7-a72d-02d9d8a6cb10 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:34.321899 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafcae6-c3fb-4ee7-a72d-02d9d8a6cb10 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:34.322366 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcafcae6-c3fb-4ee7-a72d-02d9d8a6cb10 None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:34.323253 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafcae6-c3fb-4ee7-a72d-02d9d8a6cb10 None admin] RBAC: Adding query filter params (name=image) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:34.323742 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafcae6-c3fb-4ee7-a72d-02d9d8a6cb10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:34.325506 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcafcae6-c3fb-4ee7-a72d-02d9d8a6cb10 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:34.331093 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 336/653] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:34.337344 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafcae6-c3fb-4ee7-a72d-02d9d8a6cb10 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:34.386157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0123acc-ea5f-41ed-abdd-87bec1ffffe5 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:34.426696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bf3e5-c6a6-4e2a-b478-55ea308b8ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:34.427765 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bf3e5-c6a6-4e2a-b478-55ea308b8ca1 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:34.428469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bf3e5-c6a6-4e2a-b478-55ea308b8ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:34.429052 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9bf3e5-c6a6-4e2a-b478-55ea308b8ca1 None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:34.430046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bf3e5-c6a6-4e2a-b478-55ea308b8ca1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:34.430564 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bf3e5-c6a6-4e2a-b478-55ea308b8ca1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:34.432301 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9bf3e5-c6a6-4e2a-b478-55ea308b8ca1 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:34.447640 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 318/654] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:34.452898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcafcae6-c3fb-4ee7-a72d-02d9d8a6cb10 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:34.455666 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bf3e5-c6a6-4e2a-b478-55ea308b8ca1 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:34.500856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f6553-c5bb-46c1-b4b2-272b8138d4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:34.501715 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f6553-c5bb-46c1-b4b2-272b8138d4bb None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:34.502056 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f6553-c5bb-46c1-b4b2-272b8138d4bb None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:34.502334 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805f6553-c5bb-46c1-b4b2-272b8138d4bb None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:34.503925 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f6553-c5bb-46c1-b4b2-272b8138d4bb None admin] RBAC: Adding query filter params (type=image) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:34.504244 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f6553-c5bb-46c1-b4b2-272b8138d4bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:34.505657 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805f6553-c5bb-46c1-b4b2-272b8138d4bb None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:34.513757 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 337/655] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:34 2022] GET /identity/v3/services?type=image => generated 122 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:34.547861 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:34.588473 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9bf3e5-c6a6-4e2a-b478-55ea308b8ca1 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:34.628861 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6675aa-31ed-4e09-b82e-ab1a970c8f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:34.630053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6675aa-31ed-4e09-b82e-ab1a970c8f18 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:34.630643 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6675aa-31ed-4e09-b82e-ab1a970c8f18 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:34.631123 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6675aa-31ed-4e09-b82e-ab1a970c8f18 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:34.639909 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6675aa-31ed-4e09-b82e-ab1a970c8f18 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:34.641940 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6675aa-31ed-4e09-b82e-ab1a970c8f18 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:34.658264 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-ef6675aa-31ed-4e09-b82e-ab1a970c8f18 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:34.658264 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:34.658264 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:34.658264 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:34.658264 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:34.658264 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:34.658264 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:34.658264 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:34.658264 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:34.658264 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:34.658264 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:34.658264 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:34.658264 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:39:34.658264 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:39:34.658264 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:39:34.659250 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:39:34.659250 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:34.659250 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:34.659250 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:34.659250 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:34.659250 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:34.659250 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:34.659250 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:34.659250 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:34.659250 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:34.659250 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:34.659250 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:34.659250 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:34.659250 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:34.659250 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:34.659250 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:34.659250 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:34.660142 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:39:34.660142 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:39:34.660142 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:39:34.660142 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:39:34.660142 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:39:34.660142 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:39:34.660142 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:34.660142 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:34.662794 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 319/656] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:34.669113 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f6553-c5bb-46c1-b4b2-272b8138d4bb None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:34.712537 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:34.804062 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805f6553-c5bb-46c1-b4b2-272b8138d4bb None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:34.841131 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0ca882-f92d-493d-9ad9-70fc73c8bdff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:34.842177 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ca882-f92d-493d-9ad9-70fc73c8bdff None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:34.842869 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ca882-f92d-493d-9ad9-70fc73c8bdff None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:34.843402 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0ca882-f92d-493d-9ad9-70fc73c8bdff None admin] PATH_INFO: `/v3/projects` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:34.844463 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ca882-f92d-493d-9ad9-70fc73c8bdff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:34.844952 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ca882-f92d-493d-9ad9-70fc73c8bdff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:34.846577 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0ca882-f92d-493d-9ad9-70fc73c8bdff None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:34.860770 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 338/657] 10.222.0.62 () {56 vars in 1148 bytes} [Wed May 25 15:39:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:34.867337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6675aa-31ed-4e09-b82e-ab1a970c8f18 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:34.928965 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee02a87-eff3-42d7-b1d7-e5034467d0b0 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:34.929780 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee02a87-eff3-42d7-b1d7-e5034467d0b0 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:34.930058 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee02a87-eff3-42d7-b1d7-e5034467d0b0 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:34.931542 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 339/658] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:39:34.932515 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995db17a-dd51-4ee0-a4e5-374ef1a8cbc9 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:34.932797 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995db17a-dd51-4ee0-a4e5-374ef1a8cbc9 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:34.933159 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995db17a-dd51-4ee0-a4e5-374ef1a8cbc9 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:34.934589 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 340/659] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:34.937984 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d4a87-eb9f-47ff-84ab-1d5e558435ed None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:34.938267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d4a87-eb9f-47ff-84ab-1d5e558435ed None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:34.938542 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349d4a87-eb9f-47ff-84ab-1d5e558435ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:34.956784 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-349d4a87-eb9f-47ff-84ab-1d5e558435ed None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:34.957986 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-349d4a87-eb9f-47ff-84ab-1d5e558435ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:34.984562 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6675aa-31ed-4e09-b82e-ab1a970c8f18 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:35.015565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:35.025123 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c6481-b022-400c-a2ac-f72fc179ed18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:35.025780 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c6481-b022-400c-a2ac-f72fc179ed18 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:35.026065 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c6481-b022-400c-a2ac-f72fc179ed18 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:35.026353 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c6481-b022-400c-a2ac-f72fc179ed18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:35.027165 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c6481-b022-400c-a2ac-f72fc179ed18 None admin] RBAC: Adding query filter params (role.id=ae72bfdddd1e4a94a21a0d53264ee157, scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5, user.id=d9b8b255e35c4949ba8faeb79921f141) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:35.027487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c6481-b022-400c-a2ac-f72fc179ed18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:35.029114 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c6481-b022-400c-a2ac-f72fc179ed18 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:35.031327 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 341/660] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:39:35.033209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce87cc3-0138-459c-b200-e2c49432575a None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:35.033678 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce87cc3-0138-459c-b200-e2c49432575a None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:35.034231 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce87cc3-0138-459c-b200-e2c49432575a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:35.040458 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 320/661] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:39:34 2022] GET /identity/v3/role_assignments?user.id=d9b8b255e35c4949ba8faeb79921f141&scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5&role.id=ae72bfdddd1e4a94a21a0d53264ee157 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:35.056322 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c6481-b022-400c-a2ac-f72fc179ed18 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:35.071509 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-1ce87cc3-0138-459c-b200-e2c49432575a None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:35.072819 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-1ce87cc3-0138-459c-b200-e2c49432575a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:35.092919 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:35.188577 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 342/662] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:39:35.202620 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c6481-b022-400c-a2ac-f72fc179ed18 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:35.214383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce87cc3-0138-459c-b200-e2c49432575a None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:35.241997 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2f6c3-9d4c-4604-b93c-d26af4493c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:35.242574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2f6c3-9d4c-4604-b93c-d26af4493c81 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:35.242856 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2f6c3-9d4c-4604-b93c-d26af4493c81 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:35.243130 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f2f6c3-9d4c-4604-b93c-d26af4493c81 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:35.243779 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2f6c3-9d4c-4604-b93c-d26af4493c81 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:35.245209 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f2f6c3-9d4c-4604-b93c-d26af4493c81 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:35.261170 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-90f2f6c3-9d4c-4604-b93c-d26af4493c81 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:39:35.261170 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:35.261170 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:39:35.261170 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:39:35.261170 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:39:35.261170 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:39:35.261170 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:39:35.261170 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:35.261170 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:39:35.261170 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:35.261170 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:39:35.261170 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:35.261170 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:35.261170 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:35.261170 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:35.261170 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:35.262164 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:35.262164 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:35.262164 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:35.262164 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:35.262164 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:35.262164 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:35.262164 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:35.262164 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:39:35.262164 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:39:35.262164 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:39:35.262164 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:39:35.262164 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:35.262164 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:35.262164 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:35.262164 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:35.262164 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:35.263005 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:35.263005 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:35.263005 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:35.263005 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:35.263005 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:35.263005 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:35.263005 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:35.263005 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:35.263005 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:35.263005 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:35.263005 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:35.263005 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:39:35.263005 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:35.263005 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:39:35.263005 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:35.263005 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 321/663] 10.222.0.62 () {56 vars in 1129 bytes} [Wed May 25 15:39:35 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:39:35.269581 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2f6c3-9d4c-4604-b93c-d26af4493c81 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:35.330303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:35.341864 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce87cc3-0138-459c-b200-e2c49432575a None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:35.378458 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f2f6c3-9d4c-4604-b93c-d26af4493c81 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:35.384802 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707d4fb-a542-4e10-a66d-a672ce17e02e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:35.386136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707d4fb-a542-4e10-a66d-a672ce17e02e None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:35.386633 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707d4fb-a542-4e10-a66d-a672ce17e02e None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:35.387110 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2707d4fb-a542-4e10-a66d-a672ce17e02e None admin] PATH_INFO: `/v3/services/network` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:35.388138 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707d4fb-a542-4e10-a66d-a672ce17e02e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:35.390418 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2707d4fb-a542-4e10-a66d-a672ce17e02e None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:35.408694 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-2707d4fb-a542-4e10-a66d-a672ce17e02e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:39:35.408694 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:35.408694 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:39:35.408694 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:39:35.408694 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:39:35.408694 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:39:35.408694 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:39:35.408694 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:35.408694 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:39:35.408694 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:35.408694 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:39:35.408694 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:35.408694 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:35.408694 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:35.408694 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:35.408694 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:35.408694 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:35.409756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:35.409756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:35.409756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:35.409756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:35.409756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:35.409756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:35.409756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:39:35.409756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:39:35.409756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:39:35.409756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:39:35.409756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:35.409756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:35.409756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:35.409756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:35.409756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:35.409756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:35.410697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:35.410697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:35.410697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:35.410697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:35.410697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:35.410697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:35.410697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:35.410697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:35.410697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:35.410697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:35.410697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:39:35.410697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:35.410697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:39:35.410697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:35.419517 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 343/664] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:35 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:39:35.420693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707d4fb-a542-4e10-a66d-a672ce17e02e None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:35.428337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec34e0-9eb1-477b-9837-67436acf791c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:35.429408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec34e0-9eb1-477b-9837-67436acf791c None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:35.429896 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec34e0-9eb1-477b-9837-67436acf791c None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:35.430398 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ec34e0-9eb1-477b-9837-67436acf791c None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:35.431412 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec34e0-9eb1-477b-9837-67436acf791c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:35.431922 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec34e0-9eb1-477b-9837-67436acf791c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:35.434174 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ec34e0-9eb1-477b-9837-67436acf791c None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:35.443495 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:35.444506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 322/665] 10.222.0.62 () {56 vars in 1124 bytes} [Wed May 25 15:39:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:35.448401 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec34e0-9eb1-477b-9837-67436acf791c None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:35.565470 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2707d4fb-a542-4e10-a66d-a672ce17e02e None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:35.593947 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ec34e0-9eb1-477b-9837-67436acf791c None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:35.608841 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcbe88-5633-486f-a293-9b90dd0393ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:35.610137 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcbe88-5633-486f-a293-9b90dd0393ed None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:35.614284 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcbe88-5633-486f-a293-9b90dd0393ed None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:35.614284 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fcbe88-5633-486f-a293-9b90dd0393ed None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:35.614284 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcbe88-5633-486f-a293-9b90dd0393ed None admin] RBAC: Adding query filter params (name=network) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:35.614284 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcbe88-5633-486f-a293-9b90dd0393ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:35.615495 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fcbe88-5633-486f-a293-9b90dd0393ed None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:35.617902 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:35.628370 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 344/666] 10.222.0.62 () {56 vars in 1112 bytes} [Wed May 25 15:39:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:35.629950 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcbe88-5633-486f-a293-9b90dd0393ed None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:35.637392 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e88fa3-32d2-46c7-b4d7-d1e31d6dcde2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:35.638153 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e88fa3-32d2-46c7-b4d7-d1e31d6dcde2 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:35.638493 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e88fa3-32d2-46c7-b4d7-d1e31d6dcde2 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:35.638855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e88fa3-32d2-46c7-b4d7-d1e31d6dcde2 None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:35.640407 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e88fa3-32d2-46c7-b4d7-d1e31d6dcde2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:35.644878 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e88fa3-32d2-46c7-b4d7-d1e31d6dcde2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:35.646612 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e88fa3-32d2-46c7-b4d7-d1e31d6dcde2 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:35.660538 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 323/667] 10.222.0.62 () {56 vars in 1124 bytes} [Wed May 25 15:39:35 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:35.730382 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:35.754787 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fcbe88-5633-486f-a293-9b90dd0393ed None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:35.793796 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e1eda8-e535-4284-a7fb-f001c73af9cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:35.794566 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1eda8-e535-4284-a7fb-f001c73af9cc None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:35.794916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1eda8-e535-4284-a7fb-f001c73af9cc None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:35.795819 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e1eda8-e535-4284-a7fb-f001c73af9cc None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:35.796689 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1eda8-e535-4284-a7fb-f001c73af9cc None admin] RBAC: Adding query filter params (type=network) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:35.797044 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1eda8-e535-4284-a7fb-f001c73af9cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:35.798502 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e1eda8-e535-4284-a7fb-f001c73af9cc None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:35.804347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 345/668] 10.222.0.62 () {56 vars in 1112 bytes} [Wed May 25 15:39:35 2022] GET /identity/v3/services?type=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:36.913058 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912f8f5-4685-42a0-989e-80e367175420 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:36.913584 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912f8f5-4685-42a0-989e-80e367175420 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:36.913662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2912f8f5-4685-42a0-989e-80e367175420 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:36.915266 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 324/669] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:36.921441 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465813e-288b-4a5d-9d6f-b07b7ad89847 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:36.921901 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465813e-288b-4a5d-9d6f-b07b7ad89847 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:36.921981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2465813e-288b-4a5d-9d6f-b07b7ad89847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:36.939295 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-2465813e-288b-4a5d-9d6f-b07b7ad89847 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:36.940936 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-2465813e-288b-4a5d-9d6f-b07b7ad89847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:37.016676 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 346/670] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:39:37.040162 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912f8f5-4685-42a0-989e-80e367175420 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:37.154941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2912f8f5-4685-42a0-989e-80e367175420 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:37.191584 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269d921-b069-4f23-8193-eb415c13bff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:37.192167 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269d921-b069-4f23-8193-eb415c13bff1 None admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:37.192469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269d921-b069-4f23-8193-eb415c13bff1 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:37.192747 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269d921-b069-4f23-8193-eb415c13bff1 None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:37.193478 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269d921-b069-4f23-8193-eb415c13bff1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:37.194839 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269d921-b069-4f23-8193-eb415c13bff1 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:37.301657 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 325/671] 10.222.0.62 () {60 vars in 1141 bytes} [Wed May 25 15:39:37 2022] POST /identity/v3/services => generated 242 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:39:37.417159 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75db8b-16e4-4878-8487-b230011442be None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:37.417690 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75db8b-16e4-4878-8487-b230011442be None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:37.418085 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f75db8b-16e4-4878-8487-b230011442be None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:37.419980 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 347/672] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:37.426074 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f026c-9fa7-4b04-9155-81219bfd31d8 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:37.426402 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f026c-9fa7-4b04-9155-81219bfd31d8 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:37.426635 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f026c-9fa7-4b04-9155-81219bfd31d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:37.445880 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-8d2f026c-9fa7-4b04-9155-81219bfd31d8 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:37.447031 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-8d2f026c-9fa7-4b04-9155-81219bfd31d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:37.494103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:37.535777 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 326/673] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:37 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:39:37.562649 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75db8b-16e4-4878-8487-b230011442be None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:37.640946 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:37.673785 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f75db8b-16e4-4878-8487-b230011442be None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:37.711542 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77488d-efb7-4117-9f50-c7cf08330d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:37.712264 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77488d-efb7-4117-9f50-c7cf08330d6f None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:37.712594 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77488d-efb7-4117-9f50-c7cf08330d6f None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:37.713014 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a77488d-efb7-4117-9f50-c7cf08330d6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:37.725373 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a77488d-efb7-4117-9f50-c7cf08330d6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:37.734176 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-6a77488d-efb7-4117-9f50-c7cf08330d6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:39:37.734176 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:37.734176 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:37.734176 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:37.734176 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:37.734176 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:37.734176 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:37.734176 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:37.734176 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:37.734176 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:37.734176 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:37.734176 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:37.734176 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:37.734176 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:37.734176 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:37.734176 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:37.735169 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:37.735169 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:37.735169 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:37.735169 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:37.735169 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:37.735169 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:37.735169 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:37.735169 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:37.735169 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:37.735169 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:37.735169 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:37.735169 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:37.735169 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:37.735169 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:37.735169 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:37.735169 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:37.736018 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:37.736018 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:37.736018 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:37.736018 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:37.736018 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:37.736018 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:37.736018 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:37.736018 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:37.736018 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:37.736018 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:37.736018 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:39:37.736018 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:37.740588 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 348/674] 10.222.0.62 () {56 vars in 1096 bytes} [Wed May 25 15:39:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:37.742298 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f026c-9fa7-4b04-9155-81219bfd31d8 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:37.849326 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f026c-9fa7-4b04-9155-81219bfd31d8 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:37.886822 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd35d88-4e17-42c9-8b45-d884133a4140 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:37.887531 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd35d88-4e17-42c9-8b45-d884133a4140 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:37.887846 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd35d88-4e17-42c9-8b45-d884133a4140 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:37.888093 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd35d88-4e17-42c9-8b45-d884133a4140 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:37.889025 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd35d88-4e17-42c9-8b45-d884133a4140 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:37.890160 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd35d88-4e17-42c9-8b45-d884133a4140 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:37.891263 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd35d88-4e17-42c9-8b45-d884133a4140 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:37.905539 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 327/675] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:39:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:37.908349 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77488d-efb7-4117-9f50-c7cf08330d6f None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:38.025513 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a77488d-efb7-4117-9f50-c7cf08330d6f None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:38.063961 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d7c2bf-21f2-44ea-b2b9-98ebecedda57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:38.067724 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7c2bf-21f2-44ea-b2b9-98ebecedda57 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:38.067724 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7c2bf-21f2-44ea-b2b9-98ebecedda57 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:38.067724 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d7c2bf-21f2-44ea-b2b9-98ebecedda57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:38.067724 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:38.078977 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7c2bf-21f2-44ea-b2b9-98ebecedda57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:38.080504 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d7c2bf-21f2-44ea-b2b9-98ebecedda57 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:38.099063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-f0d7c2bf-21f2-44ea-b2b9-98ebecedda57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:38.099063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:38.099063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:38.099063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:38.099063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:38.099063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:38.099063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:38.099063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:38.099063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:38.099063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:38.099063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:38.099063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:38.099063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:38.099063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:38.099063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:38.101187 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:38.101187 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:38.101187 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:38.101187 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:38.101187 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:38.101187 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:38.101187 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:38.101187 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:38.101187 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:38.101187 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:38.101187 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:38.101187 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:38.101187 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:38.101187 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:38.101187 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:38.101187 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:38.101187 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:38.103402 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:38.103402 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:38.103402 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:38.103402 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:38.106801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 349/676] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:38.106995 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd35d88-4e17-42c9-8b45-d884133a4140 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:38.144797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:38.201265 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca67d86-3307-4565-b027-bc99db934b0d None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:38.202218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca67d86-3307-4565-b027-bc99db934b0d None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:38.202790 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca67d86-3307-4565-b027-bc99db934b0d None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:38.204636 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 350/677] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:39:38.209675 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bd835-9ec8-495d-997f-49bfc5a74a1a None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:38.209955 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bd835-9ec8-495d-997f-49bfc5a74a1a None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:38.210231 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bd835-9ec8-495d-997f-49bfc5a74a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:38.220208 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd35d88-4e17-42c9-8b45-d884133a4140 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:38.229636 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-861bd835-9ec8-495d-997f-49bfc5a74a1a None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:38.230842 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-861bd835-9ec8-495d-997f-49bfc5a74a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:38.256340 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbcbe3c-6e68-4972-9a55-b5efb70c4ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:38.257039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcbe3c-6e68-4972-9a55-b5efb70c4ec6 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:38.257333 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcbe3c-6e68-4972-9a55-b5efb70c4ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:38.257611 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbcbe3c-6e68-4972-9a55-b5efb70c4ec6 None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:38.258414 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcbe3c-6e68-4972-9a55-b5efb70c4ec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:38.258725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcbe3c-6e68-4972-9a55-b5efb70c4ec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:38.260111 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbcbe3c-6e68-4972-9a55-b5efb70c4ec6 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:38.274491 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 328/678] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:38.276011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57037450-1f35-49c8-9da0-c98190622f97 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:38.276242 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57037450-1f35-49c8-9da0-c98190622f97 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:38.276546 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57037450-1f35-49c8-9da0-c98190622f97 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:38.277972 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 329/679] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:38.280935 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57037450-1f35-49c8-9da0-c98190622f97 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:38.309557 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 351/680] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:38 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 15:39:38.311481 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4a220-d8c7-4ebe-8f1d-33a61d92d615 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:38.311835 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4a220-d8c7-4ebe-8f1d-33a61d92d615 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:38.312181 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e4a220-d8c7-4ebe-8f1d-33a61d92d615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:38.339263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-e4e4a220-d8c7-4ebe-8f1d-33a61d92d615 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:38.340482 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-e4e4a220-d8c7-4ebe-8f1d-33a61d92d615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:38.390370 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:38.401005 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57037450-1f35-49c8-9da0-c98190622f97 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:38.421476 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 352/681] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:38 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 15:39:38.422766 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4a220-d8c7-4ebe-8f1d-33a61d92d615 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:38.457130 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902891f-b0f9-49f6-8a45-162a37458522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:38.457935 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902891f-b0f9-49f6-8a45-162a37458522 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:38.458224 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902891f-b0f9-49f6-8a45-162a37458522 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:38.458558 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5902891f-b0f9-49f6-8a45-162a37458522 None admin] PATH_INFO: `/v3/users/nova` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:38.466190 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902891f-b0f9-49f6-8a45-162a37458522 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:38.468334 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5902891f-b0f9-49f6-8a45-162a37458522 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:38.472008 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:38.482941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-5902891f-b0f9-49f6-8a45-162a37458522 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 15:39:38.482941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:38.482941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:38.482941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:38.482941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:38.482941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:38.482941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:38.482941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:38.482941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:38.482941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:38.482941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:38.482941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:38.482941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:39:38.482941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:39:38.482941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:39:38.482941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:39:38.490454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:38.490454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:38.490454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:39:38.490454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:38.490454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:39:38.490454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:38.490454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:38.490454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:38.490454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:38.490454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:38.490454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:38.490454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:38.490454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:38.490454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:38.490454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:38.490454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:38.490454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:38.490454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:38.491568 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:38.491568 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:38.491568 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:39:38.491568 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:39:38.491568 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:39:38.491568 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:39:38.491568 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:39:38.491568 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:39:38.491568 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 15:39:38.491568 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:38.491568 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 330/682] 10.222.0.62 () {56 vars in 1093 bytes} [Wed May 25 15:39:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:39:38.491568 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902891f-b0f9-49f6-8a45-162a37458522 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:38.536785 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e4a220-d8c7-4ebe-8f1d-33a61d92d615 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:38.576115 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22192fc-dee8-4209-a988-d87524161690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:38.577432 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22192fc-dee8-4209-a988-d87524161690 None admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:38.577937 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22192fc-dee8-4209-a988-d87524161690 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:38.577937 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22192fc-dee8-4209-a988-d87524161690 None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:38.578648 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22192fc-dee8-4209-a988-d87524161690 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:38.580027 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22192fc-dee8-4209-a988-d87524161690 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:38.599490 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5902891f-b0f9-49f6-8a45-162a37458522 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:38.632749 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e45692-182a-4cbd-84bd-c7e6eefa853e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:38.633409 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e45692-182a-4cbd-84bd-c7e6eefa853e None admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:38.633689 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e45692-182a-4cbd-84bd-c7e6eefa853e None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:38.633960 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e45692-182a-4cbd-84bd-c7e6eefa853e None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:38.634685 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e45692-182a-4cbd-84bd-c7e6eefa853e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:38.636144 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e45692-182a-4cbd-84bd-c7e6eefa853e None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:38.675578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 353/683] 10.222.0.62 () {60 vars in 1141 bytes} [Wed May 25 15:39:38 2022] POST /identity/v3/services => generated 251 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:39:38.676578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22192fc-dee8-4209-a988-d87524161690 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:38.744265 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 331/684] 10.222.0.62 () {60 vars in 1141 bytes} [Wed May 25 15:39:38 2022] POST /identity/v3/services => generated 240 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:39:38.810687 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:38.816994 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22192fc-dee8-4209-a988-d87524161690 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:38.868690 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53974fc7-6e76-4c23-b28c-20b9555aa7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:38.869842 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53974fc7-6e76-4c23-b28c-20b9555aa7c7 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:38.870379 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53974fc7-6e76-4c23-b28c-20b9555aa7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:38.870855 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53974fc7-6e76-4c23-b28c-20b9555aa7c7 None admin] PATH_INFO: `/v3/users` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:38.871952 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53974fc7-6e76-4c23-b28c-20b9555aa7c7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:38.872517 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53974fc7-6e76-4c23-b28c-20b9555aa7c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:38.874552 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53974fc7-6e76-4c23-b28c-20b9555aa7c7 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:38.896904 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 354/685] 10.222.0.62 () {56 vars in 1133 bytes} [Wed May 25 15:39:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:38.903069 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e45692-182a-4cbd-84bd-c7e6eefa853e None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:38.921200 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:39.018112 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e45692-182a-4cbd-84bd-c7e6eefa853e None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:39.055011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938873b-1304-4f06-aa1e-1271a9be810b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:39.055866 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938873b-1304-4f06-aa1e-1271a9be810b None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:39.056149 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938873b-1304-4f06-aa1e-1271a9be810b None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:39.056519 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5938873b-1304-4f06-aa1e-1271a9be810b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:39.080433 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938873b-1304-4f06-aa1e-1271a9be810b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:39.081948 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5938873b-1304-4f06-aa1e-1271a9be810b None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:39.100976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-5938873b-1304-4f06-aa1e-1271a9be810b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:39.100976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:39.100976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:39.100976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:39.100976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:39.100976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:39.100976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:39.100976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:39.100976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:39.100976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:39.100976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:39.100976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:39.100976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:39.100976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:39.100976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:39.101954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:39.101954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:39.101954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:39.101954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:39.101954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:39.101954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:39.101954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:39.101954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:39.101954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:39.101954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:39.101954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:39.101954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:39.101954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:39.101954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:39.101954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:39.101954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:39.101954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:39.102857 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:39.102857 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:39.102857 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:39.102857 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:39.102857 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 332/686] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:39.109930 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53974fc7-6e76-4c23-b28c-20b9555aa7c7 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:39.220373 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53974fc7-6e76-4c23-b28c-20b9555aa7c7 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:39.258193 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450556e6-baa7-4309-a1db-a76fcc2384e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:39.259172 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450556e6-baa7-4309-a1db-a76fcc2384e7 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:39.259630 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450556e6-baa7-4309-a1db-a76fcc2384e7 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:39.260078 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450556e6-baa7-4309-a1db-a76fcc2384e7 None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:39.260996 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450556e6-baa7-4309-a1db-a76fcc2384e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:39.261504 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450556e6-baa7-4309-a1db-a76fcc2384e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:39.263051 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450556e6-baa7-4309-a1db-a76fcc2384e7 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:39.280550 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 355/687] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:39.282762 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938873b-1304-4f06-aa1e-1271a9be810b None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:39.350502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:39.390008 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5938873b-1304-4f06-aa1e-1271a9be810b None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:39.426128 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d25c3c-9b87-4042-9f42-55d6b1230611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:39.426935 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d25c3c-9b87-4042-9f42-55d6b1230611 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:39.427572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d25c3c-9b87-4042-9f42-55d6b1230611 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:39.427854 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d25c3c-9b87-4042-9f42-55d6b1230611 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:39.435405 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d25c3c-9b87-4042-9f42-55d6b1230611 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:39.436972 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d25c3c-9b87-4042-9f42-55d6b1230611 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:39.452879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-22d25c3c-9b87-4042-9f42-55d6b1230611 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:39.452879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:39.452879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:39.452879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:39.452879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:39.452879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:39.452879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:39.452879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:39.452879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:39.452879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:39.452879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:39.452879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:39.452879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:39:39.452879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:39:39.452879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:39:39.453832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:39:39.453832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:39.453832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:39.453832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:39.453832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:39.453832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:39.453832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:39.453832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:39.453832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:39.453832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:39.453832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:39.453832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:39.453832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:39.453832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:39.453832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:39.453832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:39.453832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:39.454701 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:39:39.454701 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:39:39.454701 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:39:39.454701 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:39:39.454701 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:39:39.454701 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:39:39.454701 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:39.454701 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:39.454701 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 333/688] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:39.460014 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450556e6-baa7-4309-a1db-a76fcc2384e7 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:39.478273 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:39.572951 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450556e6-baa7-4309-a1db-a76fcc2384e7 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:39.610513 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd5d37f-5578-4c00-b6e4-20020c96c175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:39.611121 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5d37f-5578-4c00-b6e4-20020c96c175 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:39.611395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5d37f-5578-4c00-b6e4-20020c96c175 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:39.611669 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd5d37f-5578-4c00-b6e4-20020c96c175 None admin] PATH_INFO: `/v3/projects` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:39.612474 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5d37f-5578-4c00-b6e4-20020c96c175 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:39.612782 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5d37f-5578-4c00-b6e4-20020c96c175 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:39.614214 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd5d37f-5578-4c00-b6e4-20020c96c175 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:39.628076 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 356/689] 10.222.0.62 () {56 vars in 1148 bytes} [Wed May 25 15:39:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:39.633920 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d25c3c-9b87-4042-9f42-55d6b1230611 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:39.741569 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d25c3c-9b87-4042-9f42-55d6b1230611 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:39.765942 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1148d-e5c9-4cd5-8b4a-b6824feb27c1 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:39.766247 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1148d-e5c9-4cd5-8b4a-b6824feb27c1 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:39.766501 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1148d-e5c9-4cd5-8b4a-b6824feb27c1 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:39.766922 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:39.771951 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 357/690] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:39.773571 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e606acf-0954-4e32-a374-6e4c19f5a67e None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:39.773863 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e606acf-0954-4e32-a374-6e4c19f5a67e None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:39.774144 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e606acf-0954-4e32-a374-6e4c19f5a67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:39.780210 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82d0df-993a-4954-aa1c-a899d9249ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:39.780210 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82d0df-993a-4954-aa1c-a899d9249ab6 None admin] REQUEST_METHOD: `PUT` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:39.781343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82d0df-993a-4954-aa1c-a899d9249ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:39.781648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d82d0df-993a-4954-aa1c-a899d9249ab6 None admin] PATH_INFO: `/v3/projects/5e951a6f0d6947dfae3ac132afbcd4b5/users/d9b8b255e35c4949ba8faeb79921f141/roles/ae72bfdddd1e4a94a21a0d53264ee157` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:39.784227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82d0df-993a-4954-aa1c-a899d9249ab6 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e951a6f0d6947dfae3ac132afbcd4b5, user_id=d9b8b255e35c4949ba8faeb79921f141, role_id=ae72bfdddd1e4a94a21a0d53264ee157)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:39.786138 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d82d0df-993a-4954-aa1c-a899d9249ab6 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:39.791413 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-1e606acf-0954-4e32-a374-6e4c19f5a67e None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:39.792720 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-1e606acf-0954-4e32-a374-6e4c19f5a67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:39.862960 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 334/691] 10.222.0.62 () {58 vars in 1439 bytes} [Wed May 25 15:39:39 2022] PUT /identity/v3/projects/5e951a6f0d6947dfae3ac132afbcd4b5/users/d9b8b255e35c4949ba8faeb79921f141/roles/ae72bfdddd1e4a94a21a0d53264ee157 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:39:39.880637 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 358/692] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:39 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:39:39.901320 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82d0df-993a-4954-aa1c-a899d9249ab6 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:40.026123 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d82d0df-993a-4954-aa1c-a899d9249ab6 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:40.070875 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db05f9-8d08-4d5e-a3bc-9c407ebaa5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:40.071688 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db05f9-8d08-4d5e-a3bc-9c407ebaa5e4 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:40.071973 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db05f9-8d08-4d5e-a3bc-9c407ebaa5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:40.072256 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1db05f9-8d08-4d5e-a3bc-9c407ebaa5e4 None admin] PATH_INFO: `/v3/services/image` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:40.072962 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db05f9-8d08-4d5e-a3bc-9c407ebaa5e4 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:40.074529 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1db05f9-8d08-4d5e-a3bc-9c407ebaa5e4 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:40.088137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-b1db05f9-8d08-4d5e-a3bc-9c407ebaa5e4 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:39:40.088137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:40.088137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:39:40.088137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:39:40.088137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:39:40.088137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:39:40.088137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:39:40.088137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:40.088137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:39:40.088137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:40.088137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:39:40.088137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:40.088137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:40.088137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:40.088137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:40.088137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:40.088137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:40.089303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:40.089303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:40.089303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:40.089303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:40.089303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:40.089303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:40.089303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:39:40.089303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:39:40.089303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:39:40.089303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:39:40.089303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:40.089303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:40.089303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:40.089303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:40.089303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:40.089303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:40.090543 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:40.090543 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:40.090543 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:40.090543 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:40.090543 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:40.090543 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:40.090543 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:40.090543 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:40.090543 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:40.090543 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:40.090543 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:39:40.090543 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:40.090543 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:39:40.090543 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:40.090543 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 335/693] 10.222.0.62 () {56 vars in 1105 bytes} [Wed May 25 15:39:39 2022] GET /identity/v3/services/image => generated 86 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:40.099871 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e606acf-0954-4e32-a374-6e4c19f5a67e None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:40.103871 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:40.237289 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e606acf-0954-4e32-a374-6e4c19f5a67e None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:40.281294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab1a61-99a8-423a-aa19-3ef9d3805c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:40.282219 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1a61-99a8-423a-aa19-3ef9d3805c89 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:40.282636 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1a61-99a8-423a-aa19-3ef9d3805c89 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:40.283089 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bab1a61-99a8-423a-aa19-3ef9d3805c89 None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:40.283928 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab1a61-99a8-423a-aa19-3ef9d3805c89 None admin] RBAC: Adding query filter params (name=image) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:40.284364 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab1a61-99a8-423a-aa19-3ef9d3805c89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:40.286029 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bab1a61-99a8-423a-aa19-3ef9d3805c89 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:40.295860 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 359/694] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:40.297750 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db05f9-8d08-4d5e-a3bc-9c407ebaa5e4 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:40.355104 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:40.417154 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1db05f9-8d08-4d5e-a3bc-9c407ebaa5e4 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:40.455258 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed4e2a-02f5-44f6-bb19-c46c5d1fd0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:40.455924 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed4e2a-02f5-44f6-bb19-c46c5d1fd0ce None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:40.456207 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed4e2a-02f5-44f6-bb19-c46c5d1fd0ce None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:40.456510 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ed4e2a-02f5-44f6-bb19-c46c5d1fd0ce None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:40.457293 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed4e2a-02f5-44f6-bb19-c46c5d1fd0ce None admin] RBAC: Adding query filter params (type=image) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:40.457600 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed4e2a-02f5-44f6-bb19-c46c5d1fd0ce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:40.458973 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ed4e2a-02f5-44f6-bb19-c46c5d1fd0ce None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:40.464935 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 336/695] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:40 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:40.471498 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab1a61-99a8-423a-aa19-3ef9d3805c89 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:40.548037 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:40.584880 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bab1a61-99a8-423a-aa19-3ef9d3805c89 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:40.624835 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885acfc-ec73-4ba3-8755-2eb101addaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:40.625503 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885acfc-ec73-4ba3-8755-2eb101addaaa None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:40.625789 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885acfc-ec73-4ba3-8755-2eb101addaaa None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:40.626066 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885acfc-ec73-4ba3-8755-2eb101addaaa None admin] PATH_INFO: `/v3/endpoints` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:40.626853 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885acfc-ec73-4ba3-8755-2eb101addaaa None admin] RBAC: Adding query filter params (interface=public, service_id=e05583241ffb4587836183e37f7cac83, region_id=RegionOne) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:40.627165 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885acfc-ec73-4ba3-8755-2eb101addaaa None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:40.628586 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885acfc-ec73-4ba3-8755-2eb101addaaa None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:40.640590 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 360/696] 10.222.0.62 () {56 vars in 1251 bytes} [Wed May 25 15:39:40 2022] GET /identity/v3/endpoints?service_id=e05583241ffb4587836183e37f7cac83&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:40.645212 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed4e2a-02f5-44f6-bb19-c46c5d1fd0ce None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:40.764182 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ed4e2a-02f5-44f6-bb19-c46c5d1fd0ce None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:40.776601 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:40.803079 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea59a01-d915-4344-b701-c7f7bd89b4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:40.804146 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea59a01-d915-4344-b701-c7f7bd89b4ef None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:40.804730 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea59a01-d915-4344-b701-c7f7bd89b4ef None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:40.805249 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea59a01-d915-4344-b701-c7f7bd89b4ef None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:40.806190 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea59a01-d915-4344-b701-c7f7bd89b4ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:40.807802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea59a01-d915-4344-b701-c7f7bd89b4ef None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:40.815765 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 337/697] 10.222.0.62 () {56 vars in 1087 bytes} [Wed May 25 15:39:40 2022] GET /identity/v3/services => generated 1002 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:39:41.156781 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68b137-2988-428f-8ce3-9cddfabee522 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:41.157109 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68b137-2988-428f-8ce3-9cddfabee522 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:41.157348 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d68b137-2988-428f-8ce3-9cddfabee522 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:41.159032 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 361/698] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:41.164455 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f0833-af1b-4235-82c5-a5bcd79ea158 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:41.164760 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f0833-af1b-4235-82c5-a5bcd79ea158 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:41.165045 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f0833-af1b-4235-82c5-a5bcd79ea158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:41.183636 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-275f0833-af1b-4235-82c5-a5bcd79ea158 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:41.184876 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-275f0833-af1b-4235-82c5-a5bcd79ea158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:41.261650 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 338/699] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:41 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:39:41.286211 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68b137-2988-428f-8ce3-9cddfabee522 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:41.315422 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb025aef-5170-4862-bbcb-3ddebd2ef20d None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:41.316523 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb025aef-5170-4862-bbcb-3ddebd2ef20d None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:41.317103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb025aef-5170-4862-bbcb-3ddebd2ef20d None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:41.319044 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 339/700] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:39:41.324729 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6312d-57dd-4816-adc9-3845c4ec77a9 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:41.325134 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6312d-57dd-4816-adc9-3845c4ec77a9 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:41.325517 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a6312d-57dd-4816-adc9-3845c4ec77a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:41.344314 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-54a6312d-57dd-4816-adc9-3845c4ec77a9 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:41.345829 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-54a6312d-57dd-4816-adc9-3845c4ec77a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:41.411670 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d68b137-2988-428f-8ce3-9cddfabee522 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:41.432861 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 340/701] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:41 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:39:41.445877 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:41.450951 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e46089-9f53-4910-9248-2fe22aee2b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:41.452031 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e46089-9f53-4910-9248-2fe22aee2b2f None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:41.452430 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e46089-9f53-4910-9248-2fe22aee2b2f None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:41.452821 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e46089-9f53-4910-9248-2fe22aee2b2f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:41.453676 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e46089-9f53-4910-9248-2fe22aee2b2f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:41.454970 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6312d-57dd-4816-adc9-3845c4ec77a9 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:41.455370 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e46089-9f53-4910-9248-2fe22aee2b2f None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:41.472076 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-b3e46089-9f53-4910-9248-2fe22aee2b2f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:39:41.472076 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:41.472076 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:39:41.472076 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:39:41.472076 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:39:41.472076 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:39:41.472076 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:39:41.472076 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:41.472076 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:39:41.472076 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:41.472076 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:39:41.472076 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:41.472076 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:41.472076 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:41.472076 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:41.472076 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:41.473285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:41.473285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:41.473285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:41.473285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:41.473285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:41.473285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:41.473285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:41.473285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:39:41.473285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:39:41.473285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:39:41.473285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:39:41.473285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:41.473285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:41.473285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:41.473285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:41.473285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:41.474349 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:41.474349 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:41.474349 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:41.474349 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:41.474349 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:41.474349 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:41.474349 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:41.474349 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:41.474349 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:41.474349 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:41.474349 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:41.474349 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:39:41.474349 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:41.474349 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:39:41.474349 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:41.474349 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 362/702] 10.222.0.62 () {56 vars in 1129 bytes} [Wed May 25 15:39:41 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:41.480900 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e46089-9f53-4910-9248-2fe22aee2b2f None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:41.501531 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:41.582562 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a6312d-57dd-4816-adc9-3845c4ec77a9 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:41.601312 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e46089-9f53-4910-9248-2fe22aee2b2f None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:41.624837 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380e16a-4d6f-4eff-b5e8-c78ac7ac1349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:41.626172 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380e16a-4d6f-4eff-b5e8-c78ac7ac1349 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:41.626469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380e16a-4d6f-4eff-b5e8-c78ac7ac1349 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:41.626756 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6380e16a-4d6f-4eff-b5e8-c78ac7ac1349 None admin] PATH_INFO: `/v3/services/network` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:41.627537 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380e16a-4d6f-4eff-b5e8-c78ac7ac1349 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:41.628963 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6380e16a-4d6f-4eff-b5e8-c78ac7ac1349 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:41.637855 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a04fc3-728c-4146-8781-124ddf48db36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:41.638528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a04fc3-728c-4146-8781-124ddf48db36 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:41.638847 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a04fc3-728c-4146-8781-124ddf48db36 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:41.639786 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a04fc3-728c-4146-8781-124ddf48db36 None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:41.640544 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a04fc3-728c-4146-8781-124ddf48db36 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:41.640854 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a04fc3-728c-4146-8781-124ddf48db36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:41.642225 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a04fc3-728c-4146-8781-124ddf48db36 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:41.642337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-6380e16a-4d6f-4eff-b5e8-c78ac7ac1349 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:39:41.642337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:41.642337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:39:41.642337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:39:41.642337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:39:41.642337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:39:41.642337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:39:41.642337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:41.642337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:39:41.642337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:41.642337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:39:41.642337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:41.642337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:41.642337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:41.642337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:41.642337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:41.642337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:41.643248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:41.643248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:41.643248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:41.643248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:41.643248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:41.643248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:41.643248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:39:41.643248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:39:41.643248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:39:41.643248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:39:41.643248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:41.643248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:41.643248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:41.643248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:41.643248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:41.643248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:41.644332 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:41.644332 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:41.644332 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:41.644332 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:41.644332 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:41.644332 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:41.644332 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:41.644332 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:41.644332 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:41.644332 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:41.644332 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:39:41.644332 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:41.644332 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:39:41.644332 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:41.647787 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 363/704] 10.222.0.62 () {56 vars in 1124 bytes} [Wed May 25 15:39:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:41.648664 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 341/704] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:41 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:41.651170 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a04fc3-728c-4146-8781-124ddf48db36 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:41.653998 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380e16a-4d6f-4eff-b5e8-c78ac7ac1349 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:41.717697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:41.765037 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a04fc3-728c-4146-8781-124ddf48db36 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:41.767387 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:41.772006 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6380e16a-4d6f-4eff-b5e8-c78ac7ac1349 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:41.813636 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8858b1-447c-45c3-89b5-de407d8344b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:41.830864 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8858b1-447c-45c3-89b5-de407d8344b5 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:41.830864 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8858b1-447c-45c3-89b5-de407d8344b5 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:41.830864 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8858b1-447c-45c3-89b5-de407d8344b5 None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:41.830864 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8858b1-447c-45c3-89b5-de407d8344b5 None admin] RBAC: Adding query filter params (name=network) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:41.830864 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8858b1-447c-45c3-89b5-de407d8344b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:41.830864 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8858b1-447c-45c3-89b5-de407d8344b5 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:41.831377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d269a-4751-4e21-aed3-7e9892857bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:41.831377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d269a-4751-4e21-aed3-7e9892857bc8 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:41.831377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d269a-4751-4e21-aed3-7e9892857bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:41.831377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d269a-4751-4e21-aed3-7e9892857bc8 None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:41.831665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d269a-4751-4e21-aed3-7e9892857bc8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:41.831665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d269a-4751-4e21-aed3-7e9892857bc8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:41.831665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d269a-4751-4e21-aed3-7e9892857bc8 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:41.831890 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 364/705] 10.222.0.62 () {56 vars in 1112 bytes} [Wed May 25 15:39:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:41.833951 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8858b1-447c-45c3-89b5-de407d8344b5 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:41.842684 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 342/706] 10.222.0.62 () {56 vars in 1124 bytes} [Wed May 25 15:39:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:41.844506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d269a-4751-4e21-aed3-7e9892857bc8 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:41.968452 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d269a-4751-4e21-aed3-7e9892857bc8 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:41.978527 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8858b1-447c-45c3-89b5-de407d8344b5 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:42.006129 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ff4c6-e4dc-4749-881a-4ed8b2de697e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:42.007031 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ff4c6-e4dc-4749-881a-4ed8b2de697e None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:42.007163 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ff4c6-e4dc-4749-881a-4ed8b2de697e None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:42.007399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979ff4c6-e4dc-4749-881a-4ed8b2de697e None admin] PATH_INFO: `/v3/endpoints` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:42.008195 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ff4c6-e4dc-4749-881a-4ed8b2de697e None admin] RBAC: Adding query filter params (interface=public, service_id=abe2a9ef911a4f26926fb253155fbb15, region_id=RegionOne) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:42.008569 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ff4c6-e4dc-4749-881a-4ed8b2de697e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:42.010009 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979ff4c6-e4dc-4749-881a-4ed8b2de697e None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:42.011838 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:42.023464 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 343/707] 10.222.0.62 () {56 vars in 1251 bytes} [Wed May 25 15:39:41 2022] GET /identity/v3/endpoints?service_id=abe2a9ef911a4f26926fb253155fbb15&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:42.025238 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ff4c6-e4dc-4749-881a-4ed8b2de697e None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:42.027015 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1ced0-b1e3-4de9-bb85-b3e5bbf85b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:42.027978 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1ced0-b1e3-4de9-bb85-b3e5bbf85b8d None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:42.028861 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1ced0-b1e3-4de9-bb85-b3e5bbf85b8d None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:42.030593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1ced0-b1e3-4de9-bb85-b3e5bbf85b8d None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:42.031637 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1ced0-b1e3-4de9-bb85-b3e5bbf85b8d None admin] RBAC: Adding query filter params (type=network) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:42.032161 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1ced0-b1e3-4de9-bb85-b3e5bbf85b8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:42.033951 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1ced0-b1e3-4de9-bb85-b3e5bbf85b8d None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:42.047631 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 365/708] 10.222.0.62 () {56 vars in 1112 bytes} [Wed May 25 15:39:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:42.049466 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1ced0-b1e3-4de9-bb85-b3e5bbf85b8d None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:42.064103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:42.155094 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979ff4c6-e4dc-4749-881a-4ed8b2de697e None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:42.178539 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1ced0-b1e3-4de9-bb85-b3e5bbf85b8d None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:42.199635 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81f3f3-2dfd-4817-a5c3-1fc12ee57922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:42.200634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81f3f3-2dfd-4817-a5c3-1fc12ee57922 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:42.200940 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81f3f3-2dfd-4817-a5c3-1fc12ee57922 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:42.201223 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81f3f3-2dfd-4817-a5c3-1fc12ee57922 None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:42.201945 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81f3f3-2dfd-4817-a5c3-1fc12ee57922 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:42.203337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81f3f3-2dfd-4817-a5c3-1fc12ee57922 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:42.211239 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 344/709] 10.222.0.62 () {56 vars in 1087 bytes} [Wed May 25 15:39:42 2022] GET /identity/v3/services => generated 1002 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:39:42.232280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e1d7e-2219-40d3-84ac-f5912bb55dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:42.234129 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e1d7e-2219-40d3-84ac-f5912bb55dab None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:42.234626 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e1d7e-2219-40d3-84ac-f5912bb55dab None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:42.235183 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e1d7e-2219-40d3-84ac-f5912bb55dab None admin] PATH_INFO: `/v3/endpoints` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:42.236450 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e1d7e-2219-40d3-84ac-f5912bb55dab None admin] RBAC: Adding query filter params (interface=public, service_id=f73e0844f9e1418c88b4d91dd7e7da81, region_id=RegionOne) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:42.237044 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e1d7e-2219-40d3-84ac-f5912bb55dab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:42.238732 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e1d7e-2219-40d3-84ac-f5912bb55dab None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:42.251596 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 366/710] 10.222.0.62 () {56 vars in 1251 bytes} [Wed May 25 15:39:42 2022] GET /identity/v3/endpoints?service_id=f73e0844f9e1418c88b4d91dd7e7da81&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:42.254938 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81f3f3-2dfd-4817-a5c3-1fc12ee57922 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:42.330897 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43298ac-9f1a-463a-9aa9-c13184290a58 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:42.331423 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43298ac-9f1a-463a-9aa9-c13184290a58 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:42.331423 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43298ac-9f1a-463a-9aa9-c13184290a58 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:42.333038 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 367/711] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:39:42.338883 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a63f61-926d-491a-ad89-1848b6d7a078 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:42.339208 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a63f61-926d-491a-ad89-1848b6d7a078 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:42.339447 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a63f61-926d-491a-ad89-1848b6d7a078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:42.359480 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-a7a63f61-926d-491a-ad89-1848b6d7a078 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:42.361194 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-a7a63f61-926d-491a-ad89-1848b6d7a078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:42.380751 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:42.392692 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81f3f3-2dfd-4817-a5c3-1fc12ee57922 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:42.431565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da44c4-6b79-47c2-a3b6-f07dbccca921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:42.432314 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da44c4-6b79-47c2-a3b6-f07dbccca921 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:42.432619 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da44c4-6b79-47c2-a3b6-f07dbccca921 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:42.432917 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19da44c4-6b79-47c2-a3b6-f07dbccca921 None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:42.433638 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da44c4-6b79-47c2-a3b6-f07dbccca921 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:42.435087 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19da44c4-6b79-47c2-a3b6-f07dbccca921 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:42.436813 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:42.444051 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 345/712] 10.222.0.62 () {56 vars in 1087 bytes} [Wed May 25 15:39:42 2022] GET /identity/v3/services => generated 1002 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:39:42.468539 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 368/713] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:42 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:39:42.495852 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da44c4-6b79-47c2-a3b6-f07dbccca921 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:42.613215 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19da44c4-6b79-47c2-a3b6-f07dbccca921 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:42.652183 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b328e8-8eff-448b-86ba-1d5529661252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:42.653372 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b328e8-8eff-448b-86ba-1d5529661252 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:42.653899 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b328e8-8eff-448b-86ba-1d5529661252 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:42.654439 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b328e8-8eff-448b-86ba-1d5529661252 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:42.666277 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b328e8-8eff-448b-86ba-1d5529661252 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:39:42.675604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-12b328e8-8eff-448b-86ba-1d5529661252 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:39:42.675604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:42.675604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:42.675604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:42.675604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:42.675604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:42.675604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:42.675604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:42.675604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:42.675604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:42.675604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:42.675604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:42.675604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:39:42.675604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:39:42.675604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:39:42.675604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:39:42.676727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:39:42.676727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:39:42.676727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:39:42.676727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:39:42.676727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:42.676727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:42.676727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:42.676727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:42.676727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:42.676727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:42.676727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:42.676727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:42.676727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:42.676727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:42.676727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:42.676727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:42.677651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:42.677651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:42.677651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:42.677651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:42.677651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:39:42.677651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:39:42.677651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:39:42.677651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:39:42.677651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:39:42.677651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:39:42.677651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:39:42.677651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:42.677651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 346/714] 10.222.0.62 () {56 vars in 1096 bytes} [Wed May 25 15:39:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:42.682753 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a63f61-926d-491a-ad89-1848b6d7a078 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:42.793625 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a63f61-926d-491a-ad89-1848b6d7a078 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:42.831574 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b31e91-3dc6-4804-9ba3-9b1d6e36f7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:42.832256 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b31e91-3dc6-4804-9ba3-9b1d6e36f7af None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:42.832575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b31e91-3dc6-4804-9ba3-9b1d6e36f7af None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:42.832856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b31e91-3dc6-4804-9ba3-9b1d6e36f7af None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:42.833614 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b31e91-3dc6-4804-9ba3-9b1d6e36f7af None admin] RBAC: Adding query filter params (name=admin) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:42.833918 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b31e91-3dc6-4804-9ba3-9b1d6e36f7af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:42.835297 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b31e91-3dc6-4804-9ba3-9b1d6e36f7af None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:42.845486 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 369/715] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:39:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:42.850738 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b328e8-8eff-448b-86ba-1d5529661252 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:42.871225 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:42.960156 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b328e8-8eff-448b-86ba-1d5529661252 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:42.999162 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797acbd-1fbe-4dc8-8c0f-ce5e00c17443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:43.000386 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797acbd-1fbe-4dc8-8c0f-ce5e00c17443 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:43.000918 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797acbd-1fbe-4dc8-8c0f-ce5e00c17443 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:43.001396 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4797acbd-1fbe-4dc8-8c0f-ce5e00c17443 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:43.012716 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797acbd-1fbe-4dc8-8c0f-ce5e00c17443 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:43.015031 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4797acbd-1fbe-4dc8-8c0f-ce5e00c17443 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:43.034324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-4797acbd-1fbe-4dc8-8c0f-ce5e00c17443 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:43.034324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:43.034324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:43.034324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:43.034324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:43.034324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:43.034324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:43.034324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:43.034324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:43.034324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:43.034324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:43.034324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:43.034324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:43.034324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:43.034324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:43.035313 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:43.035313 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:43.035313 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:43.035313 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:43.035313 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:43.035313 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:43.035313 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:43.035313 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:43.035313 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:43.035313 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:43.035313 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:43.035313 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:43.035313 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:43.035313 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:43.035313 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:43.035313 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:43.035313 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:43.036207 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:43.036207 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:43.036207 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:43.036207 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:43.038695 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 347/716] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:43.048674 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b31e91-3dc6-4804-9ba3-9b1d6e36f7af None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:43.100788 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:43.163014 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b31e91-3dc6-4804-9ba3-9b1d6e36f7af None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:43.198321 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6db959-5b16-4937-ab3d-6f301692212e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:43.198987 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6db959-5b16-4937-ab3d-6f301692212e None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:43.199267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6db959-5b16-4937-ab3d-6f301692212e None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:43.199538 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6db959-5b16-4937-ab3d-6f301692212e None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:43.200250 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6db959-5b16-4937-ab3d-6f301692212e None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:43.200581 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6db959-5b16-4937-ab3d-6f301692212e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:43.202848 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6db959-5b16-4937-ab3d-6f301692212e None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:43.215497 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 370/717] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:43.221786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797acbd-1fbe-4dc8-8c0f-ce5e00c17443 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:43.247506 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa0204-da76-495e-a2e4-4652a5b04c10 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:43.247795 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa0204-da76-495e-a2e4-4652a5b04c10 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:43.248068 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa0204-da76-495e-a2e4-4652a5b04c10 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:43.250110 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 371/718] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:39:43.255224 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287338f2-51dc-4f7e-a313-866cc53162bf None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:43.255512 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287338f2-51dc-4f7e-a313-866cc53162bf None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:43.255793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287338f2-51dc-4f7e-a313-866cc53162bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:43.274834 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-287338f2-51dc-4f7e-a313-866cc53162bf None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:43.276107 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-287338f2-51dc-4f7e-a313-866cc53162bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:43.304042 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:43.341329 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4797acbd-1fbe-4dc8-8c0f-ce5e00c17443 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:43.372466 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 372/719] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:43 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:39:43.391590 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4e208-49ae-45a9-b01e-258a2319a466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:43.393190 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4e208-49ae-45a9-b01e-258a2319a466 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:43.393740 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4e208-49ae-45a9-b01e-258a2319a466 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:43.395103 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287338f2-51dc-4f7e-a313-866cc53162bf None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:43.395640 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4e208-49ae-45a9-b01e-258a2319a466 None admin] PATH_INFO: `/v3/users/nova` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:43.407004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4e208-49ae-45a9-b01e-258a2319a466 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:43.409141 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4e208-49ae-45a9-b01e-258a2319a466 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:43.428941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-13c4e208-49ae-45a9-b01e-258a2319a466 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 15:39:43.428941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:43.428941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:43.428941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:43.428941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:43.428941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:43.428941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:43.428941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:43.428941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:43.428941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:43.428941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:43.428941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:43.428941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:39:43.428941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:39:43.428941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:39:43.428941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:39:43.430039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:43.430039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:43.430039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:39:43.430039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:43.430039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:39:43.430039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:39:43.430039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:43.430039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:43.430039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:43.430039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:43.430039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:43.430039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:43.430039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:43.430039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:43.430039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:43.430039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:43.430039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:43.430039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:43.431000 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:43.431000 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:43.431000 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:39:43.431000 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:39:43.431000 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:39:43.431000 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:39:43.431000 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:39:43.431000 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:39:43.431000 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 15:39:43.431000 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:43.432564 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 348/720] 10.222.0.62 () {56 vars in 1093 bytes} [Wed May 25 15:39:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:43.437347 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4e208-49ae-45a9-b01e-258a2319a466 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:43.445470 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:43.539401 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287338f2-51dc-4f7e-a313-866cc53162bf None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:43.586683 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4e208-49ae-45a9-b01e-258a2319a466 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:43.588974 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b60cef-7bf0-4674-9467-aabb196f2c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:43.590038 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b60cef-7bf0-4674-9467-aabb196f2c60 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:43.590527 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b60cef-7bf0-4674-9467-aabb196f2c60 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:43.591012 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b60cef-7bf0-4674-9467-aabb196f2c60 None admin] PATH_INFO: `/v3/services/image` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:43.591892 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b60cef-7bf0-4674-9467-aabb196f2c60 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:43.594316 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b60cef-7bf0-4674-9467-aabb196f2c60 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:43.607045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-48b60cef-7bf0-4674-9467-aabb196f2c60 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:39:43.607045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:43.607045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:39:43.607045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:39:43.607045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:39:43.607045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:39:43.607045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:39:43.607045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:43.607045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:39:43.607045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:43.607045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:39:43.607045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:43.607045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:43.607045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:43.607045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:43.607045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:43.607045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:43.614453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:43.614453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:43.614453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:43.614453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:43.614453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:43.614453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:43.614453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:39:43.614453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:39:43.614453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:39:43.614453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:39:43.614453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:43.614453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:43.614453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:43.614453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:43.614453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:43.614453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:43.615317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:43.615317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:43.615317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:43.615317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:43.615317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:43.615317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:43.615317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:43.615317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:43.615317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:43.615317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:43.615317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:39:43.615317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:43.615317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 15:39:43.615317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:43.616733 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 373/721] 10.222.0.62 () {56 vars in 1105 bytes} [Wed May 25 15:39:43 2022] GET /identity/v3/services/image => generated 86 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:43.619331 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:43.620496 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b60cef-7bf0-4674-9467-aabb196f2c60 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:43.627693 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861df00d-08b4-44ef-bfe7-35aa950075fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:43.628384 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861df00d-08b4-44ef-bfe7-35aa950075fb None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:43.628784 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861df00d-08b4-44ef-bfe7-35aa950075fb None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:43.629064 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861df00d-08b4-44ef-bfe7-35aa950075fb None admin] PATH_INFO: `/v3/users` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:43.629957 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861df00d-08b4-44ef-bfe7-35aa950075fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:43.630272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861df00d-08b4-44ef-bfe7-35aa950075fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:43.631724 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861df00d-08b4-44ef-bfe7-35aa950075fb None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:43.656462 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 349/722] 10.222.0.62 () {56 vars in 1133 bytes} [Wed May 25 15:39:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:43.663071 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861df00d-08b4-44ef-bfe7-35aa950075fb None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:43.754184 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:43.759184 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b60cef-7bf0-4674-9467-aabb196f2c60 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:43.784061 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861df00d-08b4-44ef-bfe7-35aa950075fb None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:43.804255 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f86d5-600f-40ec-bc52-0adca51a36c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:43.805438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f86d5-600f-40ec-bc52-0adca51a36c9 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:43.805972 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f86d5-600f-40ec-bc52-0adca51a36c9 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:43.806469 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405f86d5-600f-40ec-bc52-0adca51a36c9 None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:43.807386 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f86d5-600f-40ec-bc52-0adca51a36c9 None admin] RBAC: Adding query filter params (name=image) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:43.807918 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f86d5-600f-40ec-bc52-0adca51a36c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:43.809654 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405f86d5-600f-40ec-bc52-0adca51a36c9 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:43.820451 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 374/723] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:43 2022] GET /identity/v3/services?name=image => generated 122 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:43.821691 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f86d5-600f-40ec-bc52-0adca51a36c9 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:43.823889 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce1f6b-a254-4a79-8076-195d345e064f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:43.824589 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce1f6b-a254-4a79-8076-195d345e064f None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:43.824877 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce1f6b-a254-4a79-8076-195d345e064f None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:43.825156 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ce1f6b-a254-4a79-8076-195d345e064f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:43.884560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:43.899160 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce1f6b-a254-4a79-8076-195d345e064f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:43.900666 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ce1f6b-a254-4a79-8076-195d345e064f None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:43.940591 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405f86d5-600f-40ec-bc52-0adca51a36c9 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:43.979332 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ef76c-ec6c-4167-a316-3247a6c704fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:43.980487 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ef76c-ec6c-4167-a316-3247a6c704fb None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:43.980981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ef76c-ec6c-4167-a316-3247a6c704fb None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:43.981492 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394ef76c-ec6c-4167-a316-3247a6c704fb None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:43.982418 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ef76c-ec6c-4167-a316-3247a6c704fb None admin] RBAC: Adding query filter params (type=image) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:43.984046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ef76c-ec6c-4167-a316-3247a6c704fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:43.985678 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394ef76c-ec6c-4167-a316-3247a6c704fb None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:43.996368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 375/724] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:43 2022] GET /identity/v3/services?type=image => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:43.997556 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ef76c-ec6c-4167-a316-3247a6c704fb None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:44.013964 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 350/725] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:39:43 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:39:44.015274 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce1f6b-a254-4a79-8076-195d345e064f None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:44.034810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:44.106227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:44.121082 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394ef76c-ec6c-4167-a316-3247a6c704fb None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:44.123068 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ce1f6b-a254-4a79-8076-195d345e064f None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:44.161030 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94162af-10e5-40bb-90eb-58cf27c578bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:44.162040 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94162af-10e5-40bb-90eb-58cf27c578bf None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:44.162329 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94162af-10e5-40bb-90eb-58cf27c578bf None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:44.162604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94162af-10e5-40bb-90eb-58cf27c578bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:44.163381 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fc6d4-9926-44d1-89b5-e9add500a37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:44.164306 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fc6d4-9926-44d1-89b5-e9add500a37f None admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:44.164836 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fc6d4-9926-44d1-89b5-e9add500a37f None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:44.165312 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93fc6d4-9926-44d1-89b5-e9add500a37f None admin] PATH_INFO: `/v3/endpoints` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:44.166280 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93fc6d4-9926-44d1-89b5-e9add500a37f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:44.167905 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93fc6d4-9926-44d1-89b5-e9add500a37f None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:44.174541 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94162af-10e5-40bb-90eb-58cf27c578bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:44.175864 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94162af-10e5-40bb-90eb-58cf27c578bf None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:44.196101 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-e94162af-10e5-40bb-90eb-58cf27c578bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:44.196101 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:44.196101 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:44.196101 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:44.196101 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:44.196101 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:44.196101 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:44.196101 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:44.196101 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:44.196101 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:44.196101 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:44.196101 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:44.196101 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:44.196101 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:44.196101 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:44.197126 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:44.197126 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:44.197126 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:44.197126 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:44.197126 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:44.197126 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:44.197126 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:44.197126 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:44.197126 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:44.197126 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:44.197126 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:44.197126 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:44.197126 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:44.197126 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:44.197126 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:44.197126 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:44.197126 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:44.198059 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:44.198059 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:44.198059 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:44.198059 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:44.198059 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 351/726] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:44.204679 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94162af-10e5-40bb-90eb-58cf27c578bf None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:44.308982 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 376/727] 10.222.0.62 () {60 vars in 1144 bytes} [Wed May 25 15:39:43 2022] POST /identity/v3/endpoints => generated 327 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:39:44.327152 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94162af-10e5-40bb-90eb-58cf27c578bf None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:44.377068 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d1a58-efdd-4630-9be4-68e0d7b30976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:44.378290 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d1a58-efdd-4630-9be4-68e0d7b30976 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:44.378802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d1a58-efdd-4630-9be4-68e0d7b30976 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:44.379290 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d1a58-efdd-4630-9be4-68e0d7b30976 None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:44.380307 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d1a58-efdd-4630-9be4-68e0d7b30976 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:44.380890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d1a58-efdd-4630-9be4-68e0d7b30976 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:44.382588 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d1a58-efdd-4630-9be4-68e0d7b30976 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:44.384609 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:44.401692 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 352/728] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:44.404341 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fc6d4-9926-44d1-89b5-e9add500a37f None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:44.512510 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:44.534881 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93fc6d4-9926-44d1-89b5-e9add500a37f None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:44.572684 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc4926-efc2-4c8f-bd5a-4173aaa98345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:44.573494 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc4926-efc2-4c8f-bd5a-4173aaa98345 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:44.573871 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc4926-efc2-4c8f-bd5a-4173aaa98345 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:44.574155 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc4926-efc2-4c8f-bd5a-4173aaa98345 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:44.582210 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc4926-efc2-4c8f-bd5a-4173aaa98345 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:44.583693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc4926-efc2-4c8f-bd5a-4173aaa98345 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:44.601571 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-abfc4926-efc2-4c8f-bd5a-4173aaa98345 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:44.601571 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:44.601571 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:44.601571 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:44.601571 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:44.601571 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:44.601571 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:44.601571 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:44.601571 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:44.601571 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:44.601571 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:44.601571 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:44.601571 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:39:44.601571 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:39:44.601571 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:39:44.602546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:39:44.602546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:44.602546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:44.602546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:44.602546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:44.602546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:44.602546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:44.602546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:44.602546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:44.602546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:44.602546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:44.602546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:44.602546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:44.602546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:44.602546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:44.602546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:44.602546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:44.603487 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:39:44.603487 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:39:44.603487 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:39:44.603487 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:39:44.603487 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:39:44.603487 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:39:44.603487 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:39:44.603487 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:44.603487 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 377/729] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:44.611317 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d1a58-efdd-4630-9be4-68e0d7b30976 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:44.725016 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d1a58-efdd-4630-9be4-68e0d7b30976 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:44.727891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db4d9b-cd93-4fad-b35f-a53c76732ac7 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:44.728166 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db4d9b-cd93-4fad-b35f-a53c76732ac7 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:44.728483 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db4d9b-cd93-4fad-b35f-a53c76732ac7 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:44.730206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 378/730] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:44.736991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d206a-4020-4dfc-8a39-db33fce556a8 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:44.737266 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d206a-4020-4dfc-8a39-db33fce556a8 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:44.737547 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d206a-4020-4dfc-8a39-db33fce556a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:44.755638 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-d30d206a-4020-4dfc-8a39-db33fce556a8 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:44.756871 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-d30d206a-4020-4dfc-8a39-db33fce556a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:44.777130 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e727e75-020b-4661-b4de-8a08159a9fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:44.778142 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e727e75-020b-4661-b4de-8a08159a9fb1 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:44.778607 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e727e75-020b-4661-b4de-8a08159a9fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:44.779062 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e727e75-020b-4661-b4de-8a08159a9fb1 None admin] PATH_INFO: `/v3/projects` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:44.780623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e727e75-020b-4661-b4de-8a08159a9fb1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:44.781380 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e727e75-020b-4661-b4de-8a08159a9fb1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:44.783725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e727e75-020b-4661-b4de-8a08159a9fb1 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:44.804628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 353/731] 10.222.0.62 () {56 vars in 1148 bytes} [Wed May 25 15:39:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:44.812200 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e727e75-020b-4661-b4de-8a08159a9fb1 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:44.840515 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 379/732] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:44 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:39:44.861297 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d206a-4020-4dfc-8a39-db33fce556a8 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:44.884781 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:44.928391 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e727e75-020b-4661-b4de-8a08159a9fb1 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:44.935189 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:44.969512 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d206a-4020-4dfc-8a39-db33fce556a8 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:44.969910 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541daaaa-814b-4f3e-a56d-7f5a3ce10935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:44.970567 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541daaaa-814b-4f3e-a56d-7f5a3ce10935 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:44.970855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541daaaa-814b-4f3e-a56d-7f5a3ce10935 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:44.971161 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541daaaa-814b-4f3e-a56d-7f5a3ce10935 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:44.972634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541daaaa-814b-4f3e-a56d-7f5a3ce10935 None admin] RBAC: Adding query filter params (role.id=ae72bfdddd1e4a94a21a0d53264ee157, scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5, user.id=d9b8b255e35c4949ba8faeb79921f141) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:44.972634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541daaaa-814b-4f3e-a56d-7f5a3ce10935 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:44.973798 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541daaaa-814b-4f3e-a56d-7f5a3ce10935 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:44.988886 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 354/733] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:39:44 2022] GET /identity/v3/role_assignments?user.id=d9b8b255e35c4949ba8faeb79921f141&scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5&role.id=ae72bfdddd1e4a94a21a0d53264ee157 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:44.990406 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac7319-5144-4fa0-890c-d1bc2e585324 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:44.990701 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac7319-5144-4fa0-890c-d1bc2e585324 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:44.991005 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac7319-5144-4fa0-890c-d1bc2e585324 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:44.993476 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 355/734] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:45.002132 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca535d8c-3ff5-40aa-99ac-c5382e756171 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:45.002421 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca535d8c-3ff5-40aa-99ac-c5382e756171 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:45.002694 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca535d8c-3ff5-40aa-99ac-c5382e756171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:45.015121 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98f6e9-9670-4bdd-bb4a-2d2d96780641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:45.016176 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98f6e9-9670-4bdd-bb4a-2d2d96780641 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:45.016491 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98f6e9-9670-4bdd-bb4a-2d2d96780641 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:45.016771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98f6e9-9670-4bdd-bb4a-2d2d96780641 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:45.017447 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98f6e9-9670-4bdd-bb4a-2d2d96780641 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:45.019117 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98f6e9-9670-4bdd-bb4a-2d2d96780641 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:45.022752 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-ca535d8c-3ff5-40aa-99ac-c5382e756171 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:45.024287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-ca535d8c-3ff5-40aa-99ac-c5382e756171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:45.033519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-fc98f6e9-9670-4bdd-bb4a-2d2d96780641 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:39:45.033519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:45.033519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:39:45.033519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:39:45.033519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:39:45.033519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:39:45.033519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:39:45.033519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:45.033519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:39:45.033519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:45.033519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:39:45.033519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:45.033519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:45.033519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:45.033519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:45.033519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:45.034575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:45.034575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:45.034575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:45.034575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:45.034575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:45.034575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:45.034575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:45.034575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:39:45.034575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:39:45.034575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:39:45.034575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:39:45.034575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:45.034575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:45.034575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:45.034575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:45.034575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:45.035439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:45.035439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:45.035439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:45.035439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:45.035439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:45.035439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:45.035439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:45.035439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:45.035439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:45.035439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:45.035439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:45.035439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:39:45.035439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:45.035439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 15:39:45.035439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:45.040841 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 380/735] 10.222.0.62 () {56 vars in 1129 bytes} [Wed May 25 15:39:44 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:45.042352 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98f6e9-9670-4bdd-bb4a-2d2d96780641 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:45.124440 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 356/736] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:45 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:39:45.150208 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca535d8c-3ff5-40aa-99ac-c5382e756171 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:45.204837 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98f6e9-9670-4bdd-bb4a-2d2d96780641 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:45.208253 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:45.244020 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea7e7a-f94f-49e2-9bec-9750f6128607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:45.246211 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea7e7a-f94f-49e2-9bec-9750f6128607 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:45.246211 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea7e7a-f94f-49e2-9bec-9750f6128607 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:45.246211 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea7e7a-f94f-49e2-9bec-9750f6128607 None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:45.246211 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea7e7a-f94f-49e2-9bec-9750f6128607 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:45.246211 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea7e7a-f94f-49e2-9bec-9750f6128607 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:45.248978 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ea7e7a-f94f-49e2-9bec-9750f6128607 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:45.250494 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:45.255139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 381/737] 10.222.0.62 () {56 vars in 1124 bytes} [Wed May 25 15:39:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:45.261249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea7e7a-f94f-49e2-9bec-9750f6128607 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:45.281470 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca535d8c-3ff5-40aa-99ac-c5382e756171 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:45.336015 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d4e7f-e711-4124-83df-15fb98e8f29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:45.337089 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d4e7f-e711-4124-83df-15fb98e8f29f None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:45.337372 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d4e7f-e711-4124-83df-15fb98e8f29f None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:45.337648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d4e7f-e711-4124-83df-15fb98e8f29f None admin] PATH_INFO: `/v3/services/network` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:45.338563 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d4e7f-e711-4124-83df-15fb98e8f29f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:45.340658 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d4e7f-e711-4124-83df-15fb98e8f29f None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:45.374591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-167d4e7f-e711-4124-83df-15fb98e8f29f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:39:45.374591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:45.374591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:39:45.374591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:39:45.374591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:39:45.374591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:39:45.374591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:39:45.374591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:45.374591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:39:45.374591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:45.374591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:39:45.374591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:45.374591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:45.374591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:45.374591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:45.374591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:45.374591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:45.375722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:45.375722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:45.375722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:45.375722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:45.375722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:45.375722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:45.375722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:39:45.375722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:39:45.375722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:39:45.375722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:39:45.375722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:45.375722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:45.375722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:45.375722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:45.375722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:45.375722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:45.376625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:45.376625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:45.376625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:45.376625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:45.376625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:45.376625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:45.376625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:45.376625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:45.376625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:45.376625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:45.376625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:39:45.376625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:45.376625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 15:39:45.376625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:45.378413 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 357/738] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:45 2022] GET /identity/v3/services/network => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:39:45.385651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d4e7f-e711-4124-83df-15fb98e8f29f None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:45.390784 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea7e7a-f94f-49e2-9bec-9750f6128607 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:45.441377 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f44b9-667c-4268-ac2b-e486fa706ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:45.442422 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f44b9-667c-4268-ac2b-e486fa706ce6 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:45.442878 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f44b9-667c-4268-ac2b-e486fa706ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:45.444082 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f44b9-667c-4268-ac2b-e486fa706ce6 None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:45.445417 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f44b9-667c-4268-ac2b-e486fa706ce6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:45.445951 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f44b9-667c-4268-ac2b-e486fa706ce6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:45.448605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f44b9-667c-4268-ac2b-e486fa706ce6 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:45.464385 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 382/739] 10.222.0.62 () {56 vars in 1124 bytes} [Wed May 25 15:39:45 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:45.468347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f44b9-667c-4268-ac2b-e486fa706ce6 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:45.495820 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d4e7f-e711-4124-83df-15fb98e8f29f None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:45.532643 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d71dc-3ec6-4562-945f-c802cb2c3e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:45.533400 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d71dc-3ec6-4562-945f-c802cb2c3e45 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:45.533762 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d71dc-3ec6-4562-945f-c802cb2c3e45 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:45.534114 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30d71dc-3ec6-4562-945f-c802cb2c3e45 None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:45.534888 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d71dc-3ec6-4562-945f-c802cb2c3e45 None admin] RBAC: Adding query filter params (name=network) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:45.535266 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d71dc-3ec6-4562-945f-c802cb2c3e45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:45.536781 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30d71dc-3ec6-4562-945f-c802cb2c3e45 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:45.538214 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:45.547698 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 358/740] 10.222.0.62 () {56 vars in 1112 bytes} [Wed May 25 15:39:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:45.551426 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d71dc-3ec6-4562-945f-c802cb2c3e45 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:45.584370 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:45.655065 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f44b9-667c-4268-ac2b-e486fa706ce6 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:45.663810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30d71dc-3ec6-4562-945f-c802cb2c3e45 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:45.707221 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437df24e-0fad-4f5c-9f64-72fc02f2f17d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:45.708366 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437df24e-0fad-4f5c-9f64-72fc02f2f17d None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:45.708937 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437df24e-0fad-4f5c-9f64-72fc02f2f17d None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:45.709425 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437df24e-0fad-4f5c-9f64-72fc02f2f17d None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:45.710432 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437df24e-0fad-4f5c-9f64-72fc02f2f17d None admin] RBAC: Adding query filter params (type=network) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:45.710935 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437df24e-0fad-4f5c-9f64-72fc02f2f17d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:45.712546 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437df24e-0fad-4f5c-9f64-72fc02f2f17d None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:45.722947 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e930a71-ddfa-4f21-9e81-05c460dc01fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:45.722947 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e930a71-ddfa-4f21-9e81-05c460dc01fe None admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:45.722947 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e930a71-ddfa-4f21-9e81-05c460dc01fe None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:45.722947 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e930a71-ddfa-4f21-9e81-05c460dc01fe None admin] PATH_INFO: `/v3/endpoints` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:45.723355 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e930a71-ddfa-4f21-9e81-05c460dc01fe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:45.723925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 359/741] 10.222.0.62 () {56 vars in 1112 bytes} [Wed May 25 15:39:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:45.724647 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e930a71-ddfa-4f21-9e81-05c460dc01fe None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:45.725625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437df24e-0fad-4f5c-9f64-72fc02f2f17d None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:45.776715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:45.816756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 383/742] 10.222.0.62 () {60 vars in 1144 bytes} [Wed May 25 15:39:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:39:45.856006 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437df24e-0fad-4f5c-9f64-72fc02f2f17d None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:45.905306 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa4dc6-89e9-40c1-8a59-7655c2822455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:45.906546 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa4dc6-89e9-40c1-8a59-7655c2822455 None admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:45.907026 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa4dc6-89e9-40c1-8a59-7655c2822455 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:45.907484 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa4dc6-89e9-40c1-8a59-7655c2822455 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:45.908491 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa4dc6-89e9-40c1-8a59-7655c2822455 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:45.910376 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa4dc6-89e9-40c1-8a59-7655c2822455 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:45.998920 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 360/743] 10.222.0.62 () {60 vars in 1144 bytes} [Wed May 25 15:39:45 2022] POST /identity/v3/endpoints => generated 327 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:39:46.942146 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effacf85-0e46-4501-ba0c-8e858fdffbb8 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:46.942678 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effacf85-0e46-4501-ba0c-8e858fdffbb8 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:46.942678 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effacf85-0e46-4501-ba0c-8e858fdffbb8 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:46.944203 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 384/744] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:46.949363 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081d196-5fd6-42db-8d28-7485e774bfcc None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:46.949792 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081d196-5fd6-42db-8d28-7485e774bfcc None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:46.949979 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081d196-5fd6-42db-8d28-7485e774bfcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:46.968183 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-d081d196-5fd6-42db-8d28-7485e774bfcc None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:46.969403 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-d081d196-5fd6-42db-8d28-7485e774bfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:47.052657 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 361/745] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:46 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:39:47.071990 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effacf85-0e46-4501-ba0c-8e858fdffbb8 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:47.197431 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effacf85-0e46-4501-ba0c-8e858fdffbb8 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:47.221393 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:47.236316 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54be8de-96d4-4568-90ee-73408e4919de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:47.237041 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54be8de-96d4-4568-90ee-73408e4919de None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:47.237330 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54be8de-96d4-4568-90ee-73408e4919de None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:47.237608 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54be8de-96d4-4568-90ee-73408e4919de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:47.316441 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54be8de-96d4-4568-90ee-73408e4919de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:47.317929 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54be8de-96d4-4568-90ee-73408e4919de None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:47.425470 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 385/746] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:39:47 2022] GET /identity/v3/auth/tokens => generated 1396 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:39:47.431051 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081d196-5fd6-42db-8d28-7485e774bfcc None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:47.446056 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c9842-7880-431f-a1d5-747495234e07 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:47.446056 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c9842-7880-431f-a1d5-747495234e07 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:47.446056 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c9842-7880-431f-a1d5-747495234e07 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:47.446554 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 386/747] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:39:47.452291 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0438b-afa4-4ad0-9b3f-f81cdd9acbbf None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:47.452555 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0438b-afa4-4ad0-9b3f-f81cdd9acbbf None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:47.452829 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0438b-afa4-4ad0-9b3f-f81cdd9acbbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:47.454165 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:47.471315 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-c4d0438b-afa4-4ad0-9b3f-f81cdd9acbbf None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:47.472538 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-c4d0438b-afa4-4ad0-9b3f-f81cdd9acbbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:47.488324 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:47.543386 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 387/748] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:47 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:39:47.543587 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081d196-5fd6-42db-8d28-7485e774bfcc None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:47.567936 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0438b-afa4-4ad0-9b3f-f81cdd9acbbf None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:47.591159 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d04f6-a1d9-4ab3-91c2-299555768c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:47.592802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d04f6-a1d9-4ab3-91c2-299555768c8e None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:47.593122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d04f6-a1d9-4ab3-91c2-299555768c8e None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:47.593328 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d04f6-a1d9-4ab3-91c2-299555768c8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:47.610878 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d04f6-a1d9-4ab3-91c2-299555768c8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:47.612840 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038d04f6-a1d9-4ab3-91c2-299555768c8e None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:47.640075 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-038d04f6-a1d9-4ab3-91c2-299555768c8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:47.640075 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:47.640075 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:47.640075 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:47.640075 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:47.640075 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:47.640075 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:47.640075 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:47.640075 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:47.640075 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:47.640075 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:47.640075 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:47.640075 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:39:47.640075 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:39:47.640075 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:39:47.641272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:39:47.641272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:47.641272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:47.641272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:47.641272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:47.641272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:47.641272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:47.641272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:47.641272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:47.641272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:47.641272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:47.641272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:47.641272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:47.641272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:47.641272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:47.641272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:47.641272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:47.642182 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:39:47.642182 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:39:47.642182 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:39:47.642182 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:47.645012 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 362/749] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:47.648932 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d04f6-a1d9-4ab3-91c2-299555768c8e None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:47.690793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0438b-afa4-4ad0-9b3f-f81cdd9acbbf None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:47.747853 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:47.753067 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806e3e6-71f6-4bf5-baa2-7ad77c31f685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:47.754204 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806e3e6-71f6-4bf5-baa2-7ad77c31f685 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:47.755341 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806e3e6-71f6-4bf5-baa2-7ad77c31f685 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:47.755814 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2806e3e6-71f6-4bf5-baa2-7ad77c31f685 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:47.757040 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806e3e6-71f6-4bf5-baa2-7ad77c31f685 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:47.758957 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2806e3e6-71f6-4bf5-baa2-7ad77c31f685 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:47.781693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-2806e3e6-71f6-4bf5-baa2-7ad77c31f685 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:39:47.781693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:47.781693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:39:47.781693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:39:47.781693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:39:47.781693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:39:47.781693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:39:47.781693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:47.781693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:39:47.781693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:47.781693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:39:47.781693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:47.781693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:47.781693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:47.781693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:47.781693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:47.782711 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:47.782711 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:47.782711 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:47.782711 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:47.782711 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:47.782711 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:47.782711 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:47.782711 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:39:47.782711 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:39:47.782711 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:39:47.782711 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:39:47.782711 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:47.782711 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:47.782711 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:47.782711 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:47.782711 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:47.783552 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:47.783552 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:47.783552 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:47.783552 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:47.783552 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:47.783552 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:47.783552 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:47.783552 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:47.783552 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:47.783552 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:47.783552 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:47.783552 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:39:47.783552 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:47.783552 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:39:47.783552 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:47.784383 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d04f6-a1d9-4ab3-91c2-299555768c8e None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:47.792182 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 388/750] 10.222.0.62 () {56 vars in 1132 bytes} [Wed May 25 15:39:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:47.793781 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806e3e6-71f6-4bf5-baa2-7ad77c31f685 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:47.811603 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:47.830042 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3452cc-f49c-4968-8eb4-cec4487f836c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:47.830704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3452cc-f49c-4968-8eb4-cec4487f836c None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:47.830979 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3452cc-f49c-4968-8eb4-cec4487f836c None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:47.831258 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3452cc-f49c-4968-8eb4-cec4487f836c None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:47.831990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3452cc-f49c-4968-8eb4-cec4487f836c None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:47.832288 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3452cc-f49c-4968-8eb4-cec4487f836c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:47.833720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3452cc-f49c-4968-8eb4-cec4487f836c None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:47.847279 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 363/751] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:47.924094 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2806e3e6-71f6-4bf5-baa2-7ad77c31f685 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:47.962740 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255ec97d-6a1b-4e0b-a501-dcb5c1bf11c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:47.964367 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ec97d-6a1b-4e0b-a501-dcb5c1bf11c3 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:47.964934 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ec97d-6a1b-4e0b-a501-dcb5c1bf11c3 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:47.965411 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255ec97d-6a1b-4e0b-a501-dcb5c1bf11c3 None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:47.966334 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ec97d-6a1b-4e0b-a501-dcb5c1bf11c3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:47.966992 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ec97d-6a1b-4e0b-a501-dcb5c1bf11c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:47.968960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255ec97d-6a1b-4e0b-a501-dcb5c1bf11c3 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:47.981025 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 389/752] 10.222.0.62 () {56 vars in 1126 bytes} [Wed May 25 15:39:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:47.983520 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3452cc-f49c-4968-8eb4-cec4487f836c None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:48.106797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3452cc-f49c-4968-8eb4-cec4487f836c None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:48.141343 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:48.147584 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac72541-eeec-45ba-8a72-f27c0c65f615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:48.148259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac72541-eeec-45ba-8a72-f27c0c65f615 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:48.148667 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac72541-eeec-45ba-8a72-f27c0c65f615 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:48.149104 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac72541-eeec-45ba-8a72-f27c0c65f615 None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:48.149774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac72541-eeec-45ba-8a72-f27c0c65f615 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:48.150082 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac72541-eeec-45ba-8a72-f27c0c65f615 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:48.151502 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac72541-eeec-45ba-8a72-f27c0c65f615 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:48.156935 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 364/753] 10.222.0.62 () {56 vars in 1126 bytes} [Wed May 25 15:39:47 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:48.248159 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a14784-9da8-409f-b115-091c947b6f39 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:48.248501 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a14784-9da8-409f-b115-091c947b6f39 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:48.248907 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a14784-9da8-409f-b115-091c947b6f39 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:48.250306 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 390/754] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:48.256232 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9e2cf-9db6-47b5-8bc2-20f6c01e41c4 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:48.256564 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9e2cf-9db6-47b5-8bc2-20f6c01e41c4 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:48.256858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a9e2cf-9db6-47b5-8bc2-20f6c01e41c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:48.274707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-c3a9e2cf-9db6-47b5-8bc2-20f6c01e41c4 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:48.275958 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-c3a9e2cf-9db6-47b5-8bc2-20f6c01e41c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:48.349979 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 365/755] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:48 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:39:48.374319 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a14784-9da8-409f-b115-091c947b6f39 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:48.458432 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:48.481683 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a14784-9da8-409f-b115-091c947b6f39 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:48.517064 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae3276-9940-4d1f-b123-2829c94d14d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:48.517861 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae3276-9940-4d1f-b123-2829c94d14d2 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:48.518140 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae3276-9940-4d1f-b123-2829c94d14d2 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:48.518408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ae3276-9940-4d1f-b123-2829c94d14d2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:48.519313 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae3276-9940-4d1f-b123-2829c94d14d2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:48.520694 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ae3276-9940-4d1f-b123-2829c94d14d2 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:48.532593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-09ae3276-9940-4d1f-b123-2829c94d14d2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:39:48.532593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:48.532593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:39:48.532593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:39:48.532593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:39:48.532593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:39:48.532593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:39:48.532593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:48.532593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:39:48.532593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:48.532593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:39:48.532593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:48.532593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:48.532593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:48.532593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:48.532593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:48.532593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:48.533771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:48.533771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:48.533771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:48.533771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:48.533771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:48.533771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:48.533771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:39:48.533771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:39:48.533771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:39:48.533771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:39:48.533771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:48.533771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:48.533771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:48.533771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:48.533771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:48.533771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:48.534954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:48.534954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:48.534954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:48.534954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:48.534954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:48.534954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:48.534954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:48.534954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:48.534954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:48.534954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:48.534954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:39:48.534954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:48.534954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:39:48.534954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:48.534954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 391/756] 10.222.0.62 () {56 vars in 1114 bytes} [Wed May 25 15:39:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:48.541185 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9e2cf-9db6-47b5-8bc2-20f6c01e41c4 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:48.641823 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a9e2cf-9db6-47b5-8bc2-20f6c01e41c4 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:48.670860 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:48.681213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1437ab48-c6fb-4e0d-ac98-1c7a8af60c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:48.688620 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437ab48-c6fb-4e0d-ac98-1c7a8af60c6b None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:48.688620 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437ab48-c6fb-4e0d-ac98-1c7a8af60c6b None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:48.688620 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1437ab48-c6fb-4e0d-ac98-1c7a8af60c6b None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:48.688620 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437ab48-c6fb-4e0d-ac98-1c7a8af60c6b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:48.688620 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437ab48-c6fb-4e0d-ac98-1c7a8af60c6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:48.688620 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1437ab48-c6fb-4e0d-ac98-1c7a8af60c6b None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:48.690800 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 366/757] 10.222.0.62 () {56 vars in 1114 bytes} [Wed May 25 15:39:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:48.696441 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae3276-9940-4d1f-b123-2829c94d14d2 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:48.798497 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ae3276-9940-4d1f-b123-2829c94d14d2 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:48.831874 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb546aa8-bfe9-4266-b66c-ced16aa96074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:48.832562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb546aa8-bfe9-4266-b66c-ced16aa96074 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:48.832854 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb546aa8-bfe9-4266-b66c-ced16aa96074 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:48.833135 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb546aa8-bfe9-4266-b66c-ced16aa96074 None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:48.833839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb546aa8-bfe9-4266-b66c-ced16aa96074 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:48.834147 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb546aa8-bfe9-4266-b66c-ced16aa96074 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:48.835558 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb546aa8-bfe9-4266-b66c-ced16aa96074 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:48.840040 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 392/758] 10.222.0.62 () {56 vars in 1114 bytes} [Wed May 25 15:39:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:50.535125 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1feabac-df4d-44d8-b778-cee15bbf391e None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:50.535646 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1feabac-df4d-44d8-b778-cee15bbf391e None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:50.535646 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1feabac-df4d-44d8-b778-cee15bbf391e None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:50.537164 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 367/759] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:50.542814 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041360f1-2c2e-46cf-b21e-7afea20e0977 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:50.543241 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041360f1-2c2e-46cf-b21e-7afea20e0977 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:50.543380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041360f1-2c2e-46cf-b21e-7afea20e0977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:50.555641 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:50.562423 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-041360f1-2c2e-46cf-b21e-7afea20e0977 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:50.563625 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-041360f1-2c2e-46cf-b21e-7afea20e0977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:50.633366 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 393/760] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:50 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:39:50.658843 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1feabac-df4d-44d8-b778-cee15bbf391e None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:50.761561 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1feabac-df4d-44d8-b778-cee15bbf391e None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:50.795932 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bca69e-0bd7-4095-a924-a98927cb2592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:50.796536 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bca69e-0bd7-4095-a924-a98927cb2592 None admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:50.796818 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bca69e-0bd7-4095-a924-a98927cb2592 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:50.797093 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bca69e-0bd7-4095-a924-a98927cb2592 None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:50.797812 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bca69e-0bd7-4095-a924-a98927cb2592 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:50.799179 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bca69e-0bd7-4095-a924-a98927cb2592 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:50.884449 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 368/761] 10.222.0.62 () {60 vars in 1141 bytes} [Wed May 25 15:39:50 2022] POST /identity/v3/services => generated 269 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:39:51.142986 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623759ec-f2da-4537-ba10-a863c1682425 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:51.143279 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623759ec-f2da-4537-ba10-a863c1682425 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:51.143566 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623759ec-f2da-4537-ba10-a863c1682425 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:51.145357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 394/762] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:51.150462 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b971a89-19f7-4f09-a2ba-e10222dabffe None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:51.150754 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b971a89-19f7-4f09-a2ba-e10222dabffe None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:51.151039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b971a89-19f7-4f09-a2ba-e10222dabffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:51.168126 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-3b971a89-19f7-4f09-a2ba-e10222dabffe None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:51.170697 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-3b971a89-19f7-4f09-a2ba-e10222dabffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:51.216025 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:51.245691 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 369/763] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:51 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:39:51.271379 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623759ec-f2da-4537-ba10-a863c1682425 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:51.378017 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623759ec-f2da-4537-ba10-a863c1682425 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:51.415917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b647b0-1669-437d-ab3b-392df4e52c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:51.416542 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b647b0-1669-437d-ab3b-392df4e52c9a None admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:51.416832 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b647b0-1669-437d-ab3b-392df4e52c9a None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:51.417111 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b647b0-1669-437d-ab3b-392df4e52c9a None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:51.417868 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b647b0-1669-437d-ab3b-392df4e52c9a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:51.419244 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b647b0-1669-437d-ab3b-392df4e52c9a None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:51.423200 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:51.516830 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 395/764] 10.222.0.62 () {60 vars in 1141 bytes} [Wed May 25 15:39:51 2022] POST /identity/v3/services => generated 251 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:39:53.169734 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31381fa2-f35a-44e6-8385-c07f2d32ecae None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:53.170387 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31381fa2-f35a-44e6-8385-c07f2d32ecae None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:53.170387 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31381fa2-f35a-44e6-8385-c07f2d32ecae None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:53.171696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 370/765] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:53.176887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb60a18-5ae7-4259-8f8d-e8203a15de20 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:53.177299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb60a18-5ae7-4259-8f8d-e8203a15de20 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:53.177446 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb60a18-5ae7-4259-8f8d-e8203a15de20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:53.193989 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-ecb60a18-5ae7-4259-8f8d-e8203a15de20 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:53.195165 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-ecb60a18-5ae7-4259-8f8d-e8203a15de20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:53.269957 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 396/766] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:53 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:39:53.293890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31381fa2-f35a-44e6-8385-c07f2d32ecae None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:53.398143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31381fa2-f35a-44e6-8385-c07f2d32ecae None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:53.433629 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42972b-5ac8-40f4-917e-f93acdaeed98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:53.434440 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42972b-5ac8-40f4-917e-f93acdaeed98 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:53.434727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42972b-5ac8-40f4-917e-f93acdaeed98 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:53.435003 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42972b-5ac8-40f4-917e-f93acdaeed98 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:53.436320 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42972b-5ac8-40f4-917e-f93acdaeed98 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:53.437726 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c42972b-5ac8-40f4-917e-f93acdaeed98 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:53.450033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-1c42972b-5ac8-40f4-917e-f93acdaeed98 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:39:53.450033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:53.450033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:39:53.450033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:39:53.450033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:39:53.450033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:39:53.450033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:39:53.450033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:53.450033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:39:53.450033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:53.450033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:39:53.450033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:53.450033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:53.450033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:53.450033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:53.450033 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:53.451046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:53.451046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:53.451046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:53.451046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:53.451046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:53.451046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:53.451046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:53.451046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:39:53.451046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:39:53.451046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:39:53.451046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:39:53.451046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:53.451046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:53.451046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:53.451046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:53.451046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:53.452526 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:53.452526 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:53.452526 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:53.452526 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:53.452526 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:53.452526 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:53.452526 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:53.452526 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:53.452526 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:53.452526 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:53.452526 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:53.452526 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:39:53.452526 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:53.452526 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:39:53.452526 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:53.456742 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 371/767] 10.222.0.62 () {56 vars in 1132 bytes} [Wed May 25 15:39:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:53.459136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb60a18-5ae7-4259-8f8d-e8203a15de20 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:53.557357 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb60a18-5ae7-4259-8f8d-e8203a15de20 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:53.580898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:53.591717 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77ecb6-a39a-4cef-b267-ac08a5e8b921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:53.592506 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77ecb6-a39a-4cef-b267-ac08a5e8b921 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:53.592794 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77ecb6-a39a-4cef-b267-ac08a5e8b921 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:53.593072 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa77ecb6-a39a-4cef-b267-ac08a5e8b921 None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:53.593862 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77ecb6-a39a-4cef-b267-ac08a5e8b921 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:53.594165 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77ecb6-a39a-4cef-b267-ac08a5e8b921 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:53.595545 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa77ecb6-a39a-4cef-b267-ac08a5e8b921 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:53.600308 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 397/768] 10.222.0.62 () {56 vars in 1126 bytes} [Wed May 25 15:39:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:53.606044 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42972b-5ac8-40f4-917e-f93acdaeed98 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:53.651677 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:53.713058 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42972b-5ac8-40f4-917e-f93acdaeed98 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:53.747394 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e6d63-bef4-45a2-bb3b-24829989d503 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:53.748737 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e6d63-bef4-45a2-bb3b-24829989d503 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:53.749045 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e6d63-bef4-45a2-bb3b-24829989d503 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:53.749390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e6d63-bef4-45a2-bb3b-24829989d503 None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:53.750003 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e6d63-bef4-45a2-bb3b-24829989d503 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:53.750313 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e6d63-bef4-45a2-bb3b-24829989d503 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:53.751685 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e6d63-bef4-45a2-bb3b-24829989d503 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:53.756517 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 372/769] 10.222.0.62 () {56 vars in 1126 bytes} [Wed May 25 15:39:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:53.762404 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77ecb6-a39a-4cef-b267-ac08a5e8b921 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:53.837698 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fa796-2277-471c-96fc-1cd854f717a9 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:53.837994 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fa796-2277-471c-96fc-1cd854f717a9 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:53.838272 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8fa796-2277-471c-96fc-1cd854f717a9 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:53.839782 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 373/770] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:53.845026 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58d3b6-3400-4973-8eea-cd6b8b722f11 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:53.845315 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58d3b6-3400-4973-8eea-cd6b8b722f11 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:53.845596 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58d3b6-3400-4973-8eea-cd6b8b722f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:53.862644 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-7f58d3b6-3400-4973-8eea-cd6b8b722f11 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:53.863842 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-7f58d3b6-3400-4973-8eea-cd6b8b722f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:53.864474 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa77ecb6-a39a-4cef-b267-ac08a5e8b921 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:53.901447 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db146dab-0ad3-488f-a7d9-ea74966922dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:53.902160 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db146dab-0ad3-488f-a7d9-ea74966922dc None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:53.902392 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db146dab-0ad3-488f-a7d9-ea74966922dc None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:53.902672 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db146dab-0ad3-488f-a7d9-ea74966922dc None admin] PATH_INFO: `/v3/endpoints` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:53.903515 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db146dab-0ad3-488f-a7d9-ea74966922dc None admin] RBAC: Adding query filter params (interface=public, service_id=575d04910ccf4f659a8537e8262c85a3, region_id=RegionOne) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:53.903830 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db146dab-0ad3-488f-a7d9-ea74966922dc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:53.905403 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db146dab-0ad3-488f-a7d9-ea74966922dc None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:53.910630 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 398/771] 10.222.0.62 () {56 vars in 1251 bytes} [Wed May 25 15:39:53 2022] GET /identity/v3/endpoints?service_id=575d04910ccf4f659a8537e8262c85a3&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:53.916354 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db146dab-0ad3-488f-a7d9-ea74966922dc None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:53.940498 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 374/772] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:53 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:39:53.963859 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58d3b6-3400-4973-8eea-cd6b8b722f11 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:53.969542 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:53.996531 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:54.021682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db146dab-0ad3-488f-a7d9-ea74966922dc None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:54.057001 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1b67f-99bb-4d4f-8534-4e7f38453247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:54.057677 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1b67f-99bb-4d4f-8534-4e7f38453247 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:54.057960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1b67f-99bb-4d4f-8534-4e7f38453247 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:54.058237 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e1b67f-99bb-4d4f-8534-4e7f38453247 None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:54.058932 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1b67f-99bb-4d4f-8534-4e7f38453247 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:54.060302 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e1b67f-99bb-4d4f-8534-4e7f38453247 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:54.067505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 399/773] 10.222.0.62 () {56 vars in 1087 bytes} [Wed May 25 15:39:53 2022] GET /identity/v3/services => generated 1498 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:39:54.069967 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58d3b6-3400-4973-8eea-cd6b8b722f11 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:54.107342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ccb40-46af-4f67-996f-73985f64a6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:54.108753 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ccb40-46af-4f67-996f-73985f64a6b2 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:54.109039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ccb40-46af-4f67-996f-73985f64a6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:54.109310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28ccb40-46af-4f67-996f-73985f64a6b2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:54.115896 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ccb40-46af-4f67-996f-73985f64a6b2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:54.115896 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28ccb40-46af-4f67-996f-73985f64a6b2 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:54.124707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-f28ccb40-46af-4f67-996f-73985f64a6b2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:39:54.124707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:54.124707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:39:54.124707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:39:54.124707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:39:54.124707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:39:54.124707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:39:54.124707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:54.124707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:39:54.124707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:54.124707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:39:54.124707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:54.124707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:54.124707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:54.124707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:54.124707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:54.124707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:54.126011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:54.126011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:54.126011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:54.126011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:54.126011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:54.126011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:54.126011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:39:54.126011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:39:54.126011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:39:54.126011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:39:54.126011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:54.126011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:54.126011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:54.126011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:54.126011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:54.126011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:54.127326 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:54.127326 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:39:54.127326 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:54.127326 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:54.127326 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:54.127326 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:54.127326 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:54.127326 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:54.127326 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:54.127326 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:54.127326 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:39:54.127326 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:54.127326 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:39:54.127326 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:39:54.127326 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 375/774] 10.222.0.62 () {56 vars in 1114 bytes} [Wed May 25 15:39:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:39:54.133782 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1b67f-99bb-4d4f-8534-4e7f38453247 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:54.245956 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e1b67f-99bb-4d4f-8534-4e7f38453247 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:54.260699 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:54.281709 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882d2f2-73b4-429d-a8e2-331111292757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:54.282380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882d2f2-73b4-429d-a8e2-331111292757 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:54.282659 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882d2f2-73b4-429d-a8e2-331111292757 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:54.283636 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e882d2f2-73b4-429d-a8e2-331111292757 None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:54.283636 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882d2f2-73b4-429d-a8e2-331111292757 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:54.283945 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882d2f2-73b4-429d-a8e2-331111292757 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:54.285291 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e882d2f2-73b4-429d-a8e2-331111292757 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:54.290142 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 400/775] 10.222.0.62 () {56 vars in 1114 bytes} [Wed May 25 15:39:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:54.296779 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ccb40-46af-4f67-996f-73985f64a6b2 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:54.394484 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:54.401571 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28ccb40-46af-4f67-996f-73985f64a6b2 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:54.436707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae982770-4d32-4fe9-ac42-91721cbcc20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:54.437375 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae982770-4d32-4fe9-ac42-91721cbcc20c None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:54.437660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae982770-4d32-4fe9-ac42-91721cbcc20c None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:54.437934 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae982770-4d32-4fe9-ac42-91721cbcc20c None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:54.438639 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae982770-4d32-4fe9-ac42-91721cbcc20c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:54.438944 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae982770-4d32-4fe9-ac42-91721cbcc20c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:54.440365 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae982770-4d32-4fe9-ac42-91721cbcc20c None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:54.445215 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 376/776] 10.222.0.62 () {56 vars in 1114 bytes} [Wed May 25 15:39:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:54.451532 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882d2f2-73b4-429d-a8e2-331111292757 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:54.554705 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e882d2f2-73b4-429d-a8e2-331111292757 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:54.588879 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b049b-7943-4097-84ee-b786864a7d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:54.589549 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b049b-7943-4097-84ee-b786864a7d2f None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:54.589833 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b049b-7943-4097-84ee-b786864a7d2f None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:54.590107 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b049b-7943-4097-84ee-b786864a7d2f None admin] PATH_INFO: `/v3/endpoints` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:54.590891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b049b-7943-4097-84ee-b786864a7d2f None admin] RBAC: Adding query filter params (interface=public, service_id=9d372b4f6e834c38b8abc1fa66be941a, region_id=RegionOne) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:54.591204 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b049b-7943-4097-84ee-b786864a7d2f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:54.593200 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b049b-7943-4097-84ee-b786864a7d2f None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:54.598379 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 401/777] 10.222.0.62 () {56 vars in 1251 bytes} [Wed May 25 15:39:54 2022] GET /identity/v3/endpoints?service_id=9d372b4f6e834c38b8abc1fa66be941a&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:54.604154 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae982770-4d32-4fe9-ac42-91721cbcc20c None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:54.705014 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae982770-4d32-4fe9-ac42-91721cbcc20c None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:54.739214 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1976601-d2cd-4793-b45d-03a7fb59d1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:54.739872 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1976601-d2cd-4793-b45d-03a7fb59d1c0 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:54.740159 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1976601-d2cd-4793-b45d-03a7fb59d1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:54.740465 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1976601-d2cd-4793-b45d-03a7fb59d1c0 None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:54.741149 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1976601-d2cd-4793-b45d-03a7fb59d1c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:54.742553 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1976601-d2cd-4793-b45d-03a7fb59d1c0 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:54.748989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 377/778] 10.222.0.62 () {56 vars in 1087 bytes} [Wed May 25 15:39:54 2022] GET /identity/v3/services => generated 1498 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:39:56.376518 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424014d-9f26-479f-991d-edccabbd1b77 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:56.377081 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424014d-9f26-479f-991d-edccabbd1b77 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:56.377081 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424014d-9f26-479f-991d-edccabbd1b77 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:56.378425 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 402/779] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:56.383818 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200df19-e933-4c4b-b6ac-ff02aa30266a None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:56.384244 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200df19-e933-4c4b-b6ac-ff02aa30266a None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:56.384362 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200df19-e933-4c4b-b6ac-ff02aa30266a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:56.401565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-5200df19-e933-4c4b-b6ac-ff02aa30266a None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:56.402760 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-5200df19-e933-4c4b-b6ac-ff02aa30266a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:56.422592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:56.472842 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 378/780] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:56 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:39:56.496492 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424014d-9f26-479f-991d-edccabbd1b77 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:56.542979 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:56.600543 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424014d-9f26-479f-991d-edccabbd1b77 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:56.634512 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab5792-adab-46a3-b3a4-0dba56d30f82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:56.635259 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab5792-adab-46a3-b3a4-0dba56d30f82 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:56.635543 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab5792-adab-46a3-b3a4-0dba56d30f82 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:56.635818 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab5792-adab-46a3-b3a4-0dba56d30f82 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:56.636490 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab5792-adab-46a3-b3a4-0dba56d30f82 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:56.637848 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ab5792-adab-46a3-b3a4-0dba56d30f82 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:56.650853 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-45ab5792-adab-46a3-b3a4-0dba56d30f82 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:39:56.650853 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:56.650853 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:39:56.650853 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:39:56.650853 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:39:56.650853 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:39:56.650853 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:39:56.650853 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:56.650853 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:39:56.650853 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:56.650853 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:39:56.650853 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:56.650853 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:56.650853 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:56.650853 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:56.650853 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:56.651886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:56.651886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:56.651886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:56.651886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:56.651886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:56.651886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:56.651886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:56.651886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:39:56.651886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:39:56.651886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:39:56.651886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:39:56.651886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:56.651886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:56.651886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:56.651886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:56.651886 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:56.652856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:56.652856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:56.652856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:56.652856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:56.652856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:56.652856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:56.652856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:56.652856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:56.652856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:56.652856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:56.652856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:56.652856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:39:56.652856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:56.652856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 15:39:56.652856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:56.652856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 403/781] 10.222.0.62 () {56 vars in 1132 bytes} [Wed May 25 15:39:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:39:56.659484 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200df19-e933-4c4b-b6ac-ff02aa30266a None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:56.762660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200df19-e933-4c4b-b6ac-ff02aa30266a None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:56.798743 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb6c1d-f3ce-4f1f-b890-cb43005d3a89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:56.799416 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb6c1d-f3ce-4f1f-b890-cb43005d3a89 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:56.799701 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb6c1d-f3ce-4f1f-b890-cb43005d3a89 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:56.799980 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5deb6c1d-f3ce-4f1f-b890-cb43005d3a89 None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:56.800720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb6c1d-f3ce-4f1f-b890-cb43005d3a89 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:56.801032 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb6c1d-f3ce-4f1f-b890-cb43005d3a89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:56.802406 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5deb6c1d-f3ce-4f1f-b890-cb43005d3a89 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:56.807168 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 379/782] 10.222.0.62 () {56 vars in 1126 bytes} [Wed May 25 15:39:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:39:56.814252 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab5792-adab-46a3-b3a4-0dba56d30f82 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:56.922809 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ab5792-adab-46a3-b3a4-0dba56d30f82 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:56.929841 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:56.957524 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3846ec-3bab-4eab-9e8d-fae2b0702a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:56.958194 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3846ec-3bab-4eab-9e8d-fae2b0702a44 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:56.958482 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3846ec-3bab-4eab-9e8d-fae2b0702a44 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:56.958765 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3846ec-3bab-4eab-9e8d-fae2b0702a44 None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:56.959534 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3846ec-3bab-4eab-9e8d-fae2b0702a44 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:56.959843 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3846ec-3bab-4eab-9e8d-fae2b0702a44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:56.961287 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3846ec-3bab-4eab-9e8d-fae2b0702a44 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:56.971697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 404/783] 10.222.0.62 () {56 vars in 1126 bytes} [Wed May 25 15:39:56 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:56.972891 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb6c1d-f3ce-4f1f-b890-cb43005d3a89 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:56.992535 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:57.033085 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935da198-dddd-4ad0-a2c6-c5ca219f7401 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:57.033369 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935da198-dddd-4ad0-a2c6-c5ca219f7401 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:57.033650 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935da198-dddd-4ad0-a2c6-c5ca219f7401 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:57.034998 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 405/784] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:39:57.039965 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443b95c-b234-43e1-bff3-cd60b2bf1cfa None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:57.040299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443b95c-b234-43e1-bff3-cd60b2bf1cfa None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:57.040614 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443b95c-b234-43e1-bff3-cd60b2bf1cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:57.058239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-7443b95c-b234-43e1-bff3-cd60b2bf1cfa None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:57.059457 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-7443b95c-b234-43e1-bff3-cd60b2bf1cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:57.079765 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5deb6c1d-f3ce-4f1f-b890-cb43005d3a89 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:57.116211 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0b1f0-42e5-4b9d-bd5e-3a783ce628eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:57.116894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0b1f0-42e5-4b9d-bd5e-3a783ce628eb None admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:57.117180 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0b1f0-42e5-4b9d-bd5e-3a783ce628eb None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:57.117452 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec0b1f0-42e5-4b9d-bd5e-3a783ce628eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:57.118193 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0b1f0-42e5-4b9d-bd5e-3a783ce628eb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:57.119559 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec0b1f0-42e5-4b9d-bd5e-3a783ce628eb None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:57.131863 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 406/785] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:57 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:39:57.156037 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443b95c-b234-43e1-bff3-cd60b2bf1cfa None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:57.213697 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 380/786] 10.222.0.62 () {60 vars in 1144 bytes} [Wed May 25 15:39:56 2022] POST /identity/v3/endpoints => generated 347 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:39:57.263049 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:57.267166 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7443b95c-b234-43e1-bff3-cd60b2bf1cfa None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:57.312723 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3960c-bdf3-4265-bb64-ced21461e5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:57.313555 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3960c-bdf3-4265-bb64-ced21461e5d8 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:57.313839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3960c-bdf3-4265-bb64-ced21461e5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:57.314117 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3960c-bdf3-4265-bb64-ced21461e5d8 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:57.314792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3960c-bdf3-4265-bb64-ced21461e5d8 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:57.316211 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d3960c-bdf3-4265-bb64-ced21461e5d8 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:57.330746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-48d3960c-bdf3-4265-bb64-ced21461e5d8 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:39:57.330746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:57.330746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:39:57.330746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:39:57.330746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:39:57.330746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:39:57.330746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:39:57.330746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:57.330746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:39:57.330746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:57.330746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:39:57.330746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:57.330746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:57.330746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:57.330746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:57.330746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:57.330746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:57.331850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:57.331850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:57.331850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:57.331850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:57.331850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:57.331850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:57.331850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:39:57.331850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:39:57.331850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:39:57.331850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:39:57.331850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:57.331850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:57.331850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:57.331850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:57.331850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:57.331850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:57.332756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:57.332756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:57.332756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:57.332756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:57.332756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:57.332756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:57.332756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:57.332756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:57.332756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:57.332756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:57.332756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:39:57.332756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:57.332756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 15:39:57.332756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:57.332756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 407/787] 10.222.0.62 () {56 vars in 1114 bytes} [Wed May 25 15:39:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:39:57.339721 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0b1f0-42e5-4b9d-bd5e-3a783ce628eb None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:57.423498 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:57.451828 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec0b1f0-42e5-4b9d-bd5e-3a783ce628eb None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:57.486505 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbaa99-f118-4ec5-8608-d4dc9c884f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:57.487094 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbaa99-f118-4ec5-8608-d4dc9c884f75 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:57.487382 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbaa99-f118-4ec5-8608-d4dc9c884f75 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:57.487663 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fbaa99-f118-4ec5-8608-d4dc9c884f75 None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:57.488374 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbaa99-f118-4ec5-8608-d4dc9c884f75 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:57.488719 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbaa99-f118-4ec5-8608-d4dc9c884f75 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:57.490115 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fbaa99-f118-4ec5-8608-d4dc9c884f75 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:57.495009 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 381/788] 10.222.0.62 () {56 vars in 1114 bytes} [Wed May 25 15:39:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:57.501946 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3960c-bdf3-4265-bb64-ced21461e5d8 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:57.605840 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d3960c-bdf3-4265-bb64-ced21461e5d8 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:57.641839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e537cea9-8a0e-40ad-a1b3-e57e2f4b8f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:57.642509 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537cea9-8a0e-40ad-a1b3-e57e2f4b8f4f None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:57.642846 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537cea9-8a0e-40ad-a1b3-e57e2f4b8f4f None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:57.643126 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e537cea9-8a0e-40ad-a1b3-e57e2f4b8f4f None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:57.644084 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537cea9-8a0e-40ad-a1b3-e57e2f4b8f4f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:57.644394 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537cea9-8a0e-40ad-a1b3-e57e2f4b8f4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:57.645794 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e537cea9-8a0e-40ad-a1b3-e57e2f4b8f4f None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:57.650731 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 408/789] 10.222.0.62 () {56 vars in 1114 bytes} [Wed May 25 15:39:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:57.657027 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbaa99-f118-4ec5-8608-d4dc9c884f75 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:57.760438 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fbaa99-f118-4ec5-8608-d4dc9c884f75 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:57.793568 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e34a34-341a-4e45-9426-3ea92caeeb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:57.794226 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e34a34-341a-4e45-9426-3ea92caeeb53 None admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:57.794580 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e34a34-341a-4e45-9426-3ea92caeeb53 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:57.795390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e34a34-341a-4e45-9426-3ea92caeeb53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:57.796116 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e34a34-341a-4e45-9426-3ea92caeeb53 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:57.797589 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e34a34-341a-4e45-9426-3ea92caeeb53 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:57.804676 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:57.859759 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 382/790] 10.222.0.62 () {60 vars in 1144 bytes} [Wed May 25 15:39:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:39:59.544922 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbe1a4-a55d-488a-9bcc-ec08a6ee8ebb None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:59.545432 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbe1a4-a55d-488a-9bcc-ec08a6ee8ebb None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:59.545564 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbe1a4-a55d-488a-9bcc-ec08a6ee8ebb None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:59.546940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 409/791] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:39:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:39:59.552589 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39937e-ff66-490b-85f2-240ab95dd500 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:59.553002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39937e-ff66-490b-85f2-240ab95dd500 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:59.553155 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb39937e-ff66-490b-85f2-240ab95dd500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:59.570815 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-bb39937e-ff66-490b-85f2-240ab95dd500 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:39:59.572008 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-bb39937e-ff66-490b-85f2-240ab95dd500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:39:59.646355 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 383/792] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:39:59 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:39:59.671979 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbe1a4-a55d-488a-9bcc-ec08a6ee8ebb None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:59.698682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:59.780632 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbe1a4-a55d-488a-9bcc-ec08a6ee8ebb None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:59.813830 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf23bd-b157-43ca-b428-177b31d1f5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:59.814631 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf23bd-b157-43ca-b428-177b31d1f5f8 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:59.814907 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf23bd-b157-43ca-b428-177b31d1f5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:59.815178 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bf23bd-b157-43ca-b428-177b31d1f5f8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:59.815814 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf23bd-b157-43ca-b428-177b31d1f5f8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:59.817239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bf23bd-b157-43ca-b428-177b31d1f5f8 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:59.829643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-50bf23bd-b157-43ca-b428-177b31d1f5f8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:39:59.829643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:59.829643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:39:59.829643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:39:59.829643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:39:59.829643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:39:59.829643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:39:59.829643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:59.829643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:39:59.829643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:59.829643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:39:59.829643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:59.829643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:39:59.829643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:39:59.829643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:39:59.829643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:39:59.829643 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:39:59.830867 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:39:59.830867 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:39:59.830867 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:39:59.830867 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:39:59.830867 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:39:59.830867 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:39:59.830867 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:39:59.830867 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:39:59.830867 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:39:59.830867 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:39:59.830867 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:39:59.830867 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:39:59.830867 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:39:59.830867 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:39:59.830867 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:39:59.830867 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:39:59.831724 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:39:59.831724 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:39:59.831724 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:39:59.831724 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:39:59.831724 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:39:59.831724 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:39:59.831724 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:39:59.831724 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:39:59.831724 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:39:59.831724 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:39:59.831724 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:39:59.831724 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:39:59.831724 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:39:59.831724 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:39:59.831724 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 410/793] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:39:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:39:59.838014 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39937e-ff66-490b-85f2-240ab95dd500 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:39:59.940631 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb39937e-ff66-490b-85f2-240ab95dd500 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:39:59.960764 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:39:59.975819 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57cec9-0b3f-47dd-960b-bce38d22021c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:39:59.976539 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57cec9-0b3f-47dd-960b-bce38d22021c None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:39:59.976806 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57cec9-0b3f-47dd-960b-bce38d22021c None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:39:59.977081 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57cec9-0b3f-47dd-960b-bce38d22021c None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:39:59.977800 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57cec9-0b3f-47dd-960b-bce38d22021c None admin] RBAC: Adding query filter params (name=compute) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:39:59.978159 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57cec9-0b3f-47dd-960b-bce38d22021c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:39:59.979528 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57cec9-0b3f-47dd-960b-bce38d22021c None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:39:59.985570 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 384/794] 10.222.0.62 () {56 vars in 1112 bytes} [Wed May 25 15:39:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:39:59.991976 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf23bd-b157-43ca-b428-177b31d1f5f8 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:00.086255 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:40:00.098212 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bf23bd-b157-43ca-b428-177b31d1f5f8 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:00.132810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a40a2c-ec9e-48e8-a9f2-a54652903494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:00.133488 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a40a2c-ec9e-48e8-a9f2-a54652903494 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:00.133852 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a40a2c-ec9e-48e8-a9f2-a54652903494 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:00.134125 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a40a2c-ec9e-48e8-a9f2-a54652903494 None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:00.134842 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a40a2c-ec9e-48e8-a9f2-a54652903494 None admin] RBAC: Adding query filter params (type=compute) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:40:00.135149 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a40a2c-ec9e-48e8-a9f2-a54652903494 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:00.136545 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a40a2c-ec9e-48e8-a9f2-a54652903494 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:00.141958 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 411/795] 10.222.0.62 () {56 vars in 1112 bytes} [Wed May 25 15:39:59 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:40:00.182854 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280b6e9-6062-478c-a440-87c6b1205d83 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:00.183144 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280b6e9-6062-478c-a440-87c6b1205d83 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:00.183427 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b280b6e9-6062-478c-a440-87c6b1205d83 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:00.184878 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 385/796] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:40:00.191651 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df282c-a478-4105-b9f1-fa758f962357 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:00.191945 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df282c-a478-4105-b9f1-fa758f962357 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:00.192228 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70df282c-a478-4105-b9f1-fa758f962357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:00.211332 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-70df282c-a478-4105-b9f1-fa758f962357 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:40:00.212600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-70df282c-a478-4105-b9f1-fa758f962357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:40:00.285425 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 412/797] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:40:00 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:40:00.311572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280b6e9-6062-478c-a440-87c6b1205d83 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:00.418646 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b280b6e9-6062-478c-a440-87c6b1205d83 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:00.453009 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fe08b-0de9-46de-8fad-d47f55d76e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:00.453666 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fe08b-0de9-46de-8fad-d47f55d76e30 None admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:00.453947 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fe08b-0de9-46de-8fad-d47f55d76e30 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:00.454220 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889fe08b-0de9-46de-8fad-d47f55d76e30 None admin] PATH_INFO: `/v3/projects` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:00.454917 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fe08b-0de9-46de-8fad-d47f55d76e30 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:00.456349 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889fe08b-0de9-46de-8fad-d47f55d76e30 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:00.457739 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: WARNING keystone.server.flask.common [None req-889fe08b-0de9-46de-8fad-d47f55d76e30 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 25 15:40:00.503998 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.sql.core [None req-889fe08b-0de9-46de-8fad-d47f55d76e30 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 15:40:00.503998 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 15:40:00.503998 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [parameters: {'id': '15b3c133623d4713a6c24aa74d397931', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 15:40:00.503998 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=99259) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 15:40:00.521320 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-889fe08b-0de9-46de-8fad-d47f55d76e30 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 15b3c133623d4713a6c24aa74d397931.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 15b3c133623d4713a6c24aa74d397931. May 25 15:40:00.521320 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:40:00.521320 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 15:40:00.521320 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 15:40:00.521320 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 15:40:00.521320 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 15:40:00.521320 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 15:40:00.521320 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application result = self._query(query) May 25 15:40:00.521320 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 15:40:00.521320 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application conn.query(q) May 25 15:40:00.521320 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 15:40:00.521320 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 15:40:00.521320 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 15:40:00.522358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application result.read() May 25 15:40:00.522358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 15:40:00.522358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 15:40:00.522358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 15:40:00.522358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 15:40:00.522358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 15:40:00.522358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 15:40:00.522358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 15:40:00.522358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 15:40:00.522358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 15:40:00.522358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:40:00.522358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 15:40:00.522358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:40:00.522358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:40:00.522358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 15:40:00.522358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 15:40:00.522358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 25 15:40:00.522358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return project_ref.to_dict() May 25 15:40:00.523592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 15:40:00.523592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application next(self.gen) May 25 15:40:00.523592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 15:40:00.523592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application yield resource May 25 15:40:00.523592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 15:40:00.523592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application next(self.gen) May 25 15:40:00.523592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 15:40:00.523592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self.session.rollback() May 25 15:40:00.523592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 15:40:00.523592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self.force_reraise() May 25 15:40:00.523592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 15:40:00.523592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise self.value May 25 15:40:00.523592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 15:40:00.523592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 15:40:00.523592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 15:40:00.523592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application session.commit() May 25 15:40:00.523592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 15:40:00.524855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 15:40:00.524855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 15:40:00.524855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._prepare_impl() May 25 15:40:00.524855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 15:40:00.524855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self.session.flush() May 25 15:40:00.524855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 15:40:00.524855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._flush(objects) May 25 15:40:00.524855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 15:40:00.524855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 15:40:00.524855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 15:40:00.524855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application compat.raise_( May 25 15:40:00.524855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 15:40:00.524855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception May 25 15:40:00.524855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 15:40:00.524855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application flush_context.execute() May 25 15:40:00.524855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 15:40:00.524855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rec.execute(self) May 25 15:40:00.526135 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 15:40:00.526135 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 15:40:00.526135 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 15:40:00.526135 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 15:40:00.526135 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 15:40:00.526135 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 15:40:00.526135 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 15:40:00.526135 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 15:40:00.526135 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 15:40:00.526135 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 15:40:00.526135 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 15:40:00.526135 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 15:40:00.526135 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 15:40:00.526135 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 15:40:00.526135 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 15:40:00.527113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 15:40:00.527113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 15:40:00.527113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception May 25 15:40:00.527113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 15:40:00.527113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 15:40:00.527113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 15:40:00.527113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 15:40:00.527113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 15:40:00.527113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application result = self._query(query) May 25 15:40:00.527113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 15:40:00.527113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application conn.query(q) May 25 15:40:00.527113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 15:40:00.527113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 15:40:00.527113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 15:40:00.527113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application result.read() May 25 15:40:00.527113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 15:40:00.527113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 15:40:00.528454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 15:40:00.528454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 15:40:00.528454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 15:40:00.528454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 15:40:00.528454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 15:40:00.528454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 15:40:00.528454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 15:40:00.528454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 15:40:00.528454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [parameters: {'id': '15b3c133623d4713a6c24aa74d397931', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 15:40:00.528454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 15:40:00.528454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:40:00.528454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:40:00.528454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:40:00.528454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:40:00.528454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 25 15:40:00.529492 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 25 15:40:00.529492 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 15:40:00.529492 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 15:40:00.529492 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 25 15:40:00.529492 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:40:00.529492 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:40:00.529492 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:40:00.529492 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:40:00.529492 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:40:00.529492 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:40:00.529492 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:40:00.529492 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:40:00.529492 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:40:00.529492 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:40:00.529492 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:40:00.529492 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:40:00.529492 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:40:00.530795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:40:00.530795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 25 15:40:00.530795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 25 15:40:00.530795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:40:00.530795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:40:00.530795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 25 15:40:00.530795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.Conflict( May 25 15:40:00.530795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 15b3c133623d4713a6c24aa74d397931. May 25 15:40:00.530795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:40:00.530795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 386/798] 10.222.0.62 () {60 vars in 1140 bytes} [Wed May 25 15:40:00 2022] POST /identity/v3/projects => generated 262 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 15:40:00.531594 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df282c-a478-4105-b9f1-fa758f962357 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:00.617558 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:40:00.636771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70df282c-a478-4105-b9f1-fa758f962357 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:00.671755 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6897a8f-0749-4f70-b714-e7fdf44928f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:00.672525 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6897a8f-0749-4f70-b714-e7fdf44928f3 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:00.672808 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6897a8f-0749-4f70-b714-e7fdf44928f3 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:00.673077 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6897a8f-0749-4f70-b714-e7fdf44928f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:00.679978 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6897a8f-0749-4f70-b714-e7fdf44928f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:00.681467 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6897a8f-0749-4f70-b714-e7fdf44928f3 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:00.695308 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-c6897a8f-0749-4f70-b714-e7fdf44928f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:40:00.695308 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:40:00.695308 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:40:00.695308 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:40:00.695308 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:40:00.695308 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:40:00.695308 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:40:00.695308 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:40:00.695308 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:40:00.695308 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:40:00.695308 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:40:00.695308 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:40:00.695308 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:40:00.695308 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:40:00.695308 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:40:00.696249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:40:00.696249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:40:00.696249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:40:00.696249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:40:00.696249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:40:00.696249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:40:00.696249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:40:00.696249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:40:00.696249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:40:00.696249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:40:00.696249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:40:00.696249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:40:00.696249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:40:00.696249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:40:00.696249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:40:00.696249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:40:00.696249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:40:00.697298 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:40:00.697298 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:40:00.697298 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:40:00.697298 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:40:00.697298 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:40:00.697298 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:40:00.697298 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:40:00.697298 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:40:00.697298 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 413/799] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:40:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:40:00.703470 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fe08b-0de9-46de-8fad-d47f55d76e30 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:00.746588 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:40:00.807148 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889fe08b-0de9-46de-8fad-d47f55d76e30 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:00.841798 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d81538-fe15-41c4-ad68-398a7b2481f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:00.842314 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d81538-fe15-41c4-ad68-398a7b2481f3 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:00.842571 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d81538-fe15-41c4-ad68-398a7b2481f3 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:00.842847 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d81538-fe15-41c4-ad68-398a7b2481f3 None admin] PATH_INFO: `/v3/projects` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:00.843601 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d81538-fe15-41c4-ad68-398a7b2481f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:40:00.843907 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d81538-fe15-41c4-ad68-398a7b2481f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:00.845628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d81538-fe15-41c4-ad68-398a7b2481f3 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:00.865863 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 387/800] 10.222.0.62 () {56 vars in 1112 bytes} [Wed May 25 15:40:00 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:40:02.441554 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee7ae3-59c7-4c77-8f5f-258f175f4b2a None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:02.442062 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee7ae3-59c7-4c77-8f5f-258f175f4b2a None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:02.442062 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fee7ae3-59c7-4c77-8f5f-258f175f4b2a None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:02.443376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 414/801] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:40:02.448776 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214e38e-e55a-48df-ac8d-40d2d05c4c50 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:02.449189 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214e38e-e55a-48df-ac8d-40d2d05c4c50 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:02.449462 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d214e38e-e55a-48df-ac8d-40d2d05c4c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:02.467755 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-d214e38e-e55a-48df-ac8d-40d2d05c4c50 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:40:02.469302 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-d214e38e-e55a-48df-ac8d-40d2d05c4c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:40:02.537950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 388/802] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:40:02 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:40:02.561577 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee7ae3-59c7-4c77-8f5f-258f175f4b2a None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:02.667336 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fee7ae3-59c7-4c77-8f5f-258f175f4b2a None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:02.701503 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94948199-3ec6-4bbb-bb40-a0dc3f61a883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:02.702182 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94948199-3ec6-4bbb-bb40-a0dc3f61a883 None admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:02.702470 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94948199-3ec6-4bbb-bb40-a0dc3f61a883 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:02.702746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94948199-3ec6-4bbb-bb40-a0dc3f61a883 None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:02.703471 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94948199-3ec6-4bbb-bb40-a0dc3f61a883 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:02.704862 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94948199-3ec6-4bbb-bb40-a0dc3f61a883 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:02.779874 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 415/803] 10.222.0.62 () {60 vars in 1141 bytes} [Wed May 25 15:40:02 2022] POST /identity/v3/services => generated 242 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:40:03.232809 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d4843-1df4-4496-ae0f-35e0ada401ee None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:03.233102 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d4843-1df4-4496-ae0f-35e0ada401ee None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:03.233409 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d4843-1df4-4496-ae0f-35e0ada401ee None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:03.234809 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 389/804] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:40:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:40:03.240102 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd144b-00d8-4871-8786-76c9105513e7 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:03.240496 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd144b-00d8-4871-8786-76c9105513e7 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:03.240782 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cd144b-00d8-4871-8786-76c9105513e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:03.245860 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:40:03.257989 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-82cd144b-00d8-4871-8786-76c9105513e7 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:40:03.261720 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-82cd144b-00d8-4871-8786-76c9105513e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:40:03.333589 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 416/805] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:40:03 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:40:03.361866 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d4843-1df4-4496-ae0f-35e0ada401ee None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:03.395102 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:40:03.469470 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d4843-1df4-4496-ae0f-35e0ada401ee None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:03.505041 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d838b-8a6f-4e6a-8469-98c28691f886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:03.505704 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d838b-8a6f-4e6a-8469-98c28691f886 None admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:03.505988 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d838b-8a6f-4e6a-8469-98c28691f886 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:03.506263 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d838b-8a6f-4e6a-8469-98c28691f886 None admin] PATH_INFO: `/v3/users` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:03.506962 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d838b-8a6f-4e6a-8469-98c28691f886 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:03.508389 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d838b-8a6f-4e6a-8469-98c28691f886 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:03.567213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.sql.core [None req-041d838b-8a6f-4e6a-8469-98c28691f886 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 15:40:03.567213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 15:40:03.567213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [parameters: {'user_id': '2961e88762614665a97dd615809f5c57', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 15:40:03.567213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=99259) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 15:40:03.574696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-041d838b-8a6f-4e6a-8469-98c28691f886 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 15:40:03.574696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:40:03.574696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 15:40:03.574696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 15:40:03.574696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 15:40:03.574696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 15:40:03.574696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 15:40:03.574696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application result = self._query(query) May 25 15:40:03.574696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 15:40:03.574696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application conn.query(q) May 25 15:40:03.574696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 15:40:03.574696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 15:40:03.574696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 15:40:03.574696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application result.read() May 25 15:40:03.574696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 15:40:03.575748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 15:40:03.575748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 15:40:03.575748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 15:40:03.575748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 15:40:03.575748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 15:40:03.575748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 15:40:03.575748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 15:40:03.575748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 15:40:03.575748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:40:03.575748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 15:40:03.575748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:40:03.575748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:40:03.575748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 15:40:03.575748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 15:40:03.575748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 25 15:40:03.575748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 25 15:40:03.575748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 15:40:03.575748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application next(self.gen) May 25 15:40:03.577321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 15:40:03.577321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application yield resource May 25 15:40:03.577321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 15:40:03.577321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application next(self.gen) May 25 15:40:03.577321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 15:40:03.577321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self.session.rollback() May 25 15:40:03.577321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 15:40:03.577321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self.force_reraise() May 25 15:40:03.577321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 15:40:03.577321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise self.value May 25 15:40:03.577321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 15:40:03.577321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 15:40:03.577321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 15:40:03.577321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application session.commit() May 25 15:40:03.577321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 15:40:03.577321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 15:40:03.577321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 15:40:03.578205 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._prepare_impl() May 25 15:40:03.578205 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 15:40:03.578205 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self.session.flush() May 25 15:40:03.578205 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 15:40:03.578205 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._flush(objects) May 25 15:40:03.578205 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 15:40:03.578205 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 15:40:03.578205 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 15:40:03.578205 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application compat.raise_( May 25 15:40:03.578205 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 15:40:03.578205 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception May 25 15:40:03.578205 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 15:40:03.578205 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application flush_context.execute() May 25 15:40:03.578205 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 15:40:03.578205 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rec.execute(self) May 25 15:40:03.578205 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 15:40:03.578205 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 15:40:03.579103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 15:40:03.579103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 15:40:03.579103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 25 15:40:03.579103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application result = connection._execute_20( May 25 15:40:03.579103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 15:40:03.579103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 15:40:03.579103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 15:40:03.579103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 15:40:03.579103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 15:40:03.579103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 15:40:03.579103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 15:40:03.579103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 15:40:03.579103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 15:40:03.579103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 15:40:03.579103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 15:40:03.579103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception May 25 15:40:03.579950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 15:40:03.579950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 15:40:03.579950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 15:40:03.579950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 15:40:03.579950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 15:40:03.579950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application result = self._query(query) May 25 15:40:03.579950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 15:40:03.579950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application conn.query(q) May 25 15:40:03.579950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 15:40:03.579950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 15:40:03.579950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 15:40:03.579950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application result.read() May 25 15:40:03.579950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 15:40:03.579950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 15:40:03.579950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 15:40:03.579950 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 15:40:03.580810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 15:40:03.580810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 15:40:03.580810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 15:40:03.580810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 15:40:03.580810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 15:40:03.580810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 15:40:03.580810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [parameters: {'user_id': '2961e88762614665a97dd615809f5c57', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 15:40:03.580810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 15:40:03.580810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:40:03.580810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:40:03.580810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:40:03.580810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:40:03.580810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:40:03.580810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:40:03.580810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:40:03.585302 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:40:03.585302 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:40:03.585302 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:40:03.585302 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:40:03.585302 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:40:03.585302 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:40:03.585302 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:40:03.585302 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 25 15:40:03.585302 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 25 15:40:03.585302 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:40:03.585302 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:40:03.585302 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:40:03.585302 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:40:03.585302 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:40:03.585302 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:40:03.585302 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 25 15:40:03.585302 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 25 15:40:03.586434 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 25 15:40:03.586434 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 25 15:40:03.586434 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 15:40:03.586434 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 15:40:03.586434 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 15:40:03.586434 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:40:03.586434 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 390/806] 10.222.0.62 () {60 vars in 1131 bytes} [Wed May 25 15:40:03 2022] POST /identity/v3/users => generated 160 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 15:40:03.586908 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd144b-00d8-4871-8786-76c9105513e7 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:03.689808 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cd144b-00d8-4871-8786-76c9105513e7 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:03.715915 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:40:03.723845 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c97b36e-c919-49b0-98d4-6705f473973d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:03.724607 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97b36e-c919-49b0-98d4-6705f473973d None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:03.724896 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97b36e-c919-49b0-98d4-6705f473973d None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:03.725173 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c97b36e-c919-49b0-98d4-6705f473973d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:03.732861 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97b36e-c919-49b0-98d4-6705f473973d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:03.734454 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c97b36e-c919-49b0-98d4-6705f473973d None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:03.750347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-2c97b36e-c919-49b0-98d4-6705f473973d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:40:03.750347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:40:03.750347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:40:03.750347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:40:03.750347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:40:03.750347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:40:03.750347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:40:03.750347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:40:03.750347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:40:03.750347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:40:03.750347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:40:03.750347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:40:03.750347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:40:03.750347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:40:03.750347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:40:03.750347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:40:03.756156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:40:03.756156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:40:03.756156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:40:03.756156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:40:03.756156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:40:03.756156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:40:03.756156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:40:03.756156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:40:03.756156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:40:03.756156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:40:03.756156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:40:03.756156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:40:03.756156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:40:03.756156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:40:03.756156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:40:03.756156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:40:03.756156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:40:03.756156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:40:03.757306 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:40:03.757306 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:40:03.757306 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:40:03.757306 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:40:03.757306 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:40:03.757306 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:40:03.757306 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:40:03.757306 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:40:03.757306 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 15:40:03.757306 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:40:03.757306 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 417/807] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:40:03 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:40:03.757911 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d838b-8a6f-4e6a-8469-98c28691f886 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:03.851251 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:40:03.860555 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d838b-8a6f-4e6a-8469-98c28691f886 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:03.894348 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a1652-1460-49fe-ad97-b3047e856b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:03.895025 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a1652-1460-49fe-ad97-b3047e856b52 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:03.895311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a1652-1460-49fe-ad97-b3047e856b52 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:03.895589 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a1652-1460-49fe-ad97-b3047e856b52 None admin] PATH_INFO: `/v3/users` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:03.896397 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a1652-1460-49fe-ad97-b3047e856b52 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:40:03.896810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a1652-1460-49fe-ad97-b3047e856b52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:03.898448 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a1652-1460-49fe-ad97-b3047e856b52 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:03.939935 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 391/808] 10.222.0.62 () {56 vars in 1101 bytes} [Wed May 25 15:40:03 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:40:05.110337 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01d0a2-1cca-4b96-80c6-fef4b8ae456c None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:05.110863 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01d0a2-1cca-4b96-80c6-fef4b8ae456c None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:05.110863 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01d0a2-1cca-4b96-80c6-fef4b8ae456c None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:05.112254 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 418/809] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:40:05.117921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbd94d-222a-4374-89d1-519f537e2d1a None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:05.118395 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbd94d-222a-4374-89d1-519f537e2d1a None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:05.118503 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fbd94d-222a-4374-89d1-519f537e2d1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:05.137971 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-d5fbd94d-222a-4374-89d1-519f537e2d1a None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:40:05.141077 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-d5fbd94d-222a-4374-89d1-519f537e2d1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:40:05.217403 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 392/810] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:40:05 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:40:05.243875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01d0a2-1cca-4b96-80c6-fef4b8ae456c None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:05.356353 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01d0a2-1cca-4b96-80c6-fef4b8ae456c None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:05.395492 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27d8d1-13f9-410f-bf00-dceb692933f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:05.396198 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27d8d1-13f9-410f-bf00-dceb692933f8 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:05.396511 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27d8d1-13f9-410f-bf00-dceb692933f8 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:05.396788 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27d8d1-13f9-410f-bf00-dceb692933f8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:05.397441 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27d8d1-13f9-410f-bf00-dceb692933f8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:05.398828 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27d8d1-13f9-410f-bf00-dceb692933f8 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:05.411384 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-6b27d8d1-13f9-410f-bf00-dceb692933f8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:40:05.411384 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:40:05.411384 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:40:05.411384 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:40:05.411384 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:40:05.411384 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:40:05.411384 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:40:05.411384 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:40:05.411384 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:40:05.411384 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:40:05.411384 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:40:05.411384 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:40:05.411384 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:40:05.411384 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:40:05.411384 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:40:05.411384 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:40:05.411384 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:40:05.412664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:40:05.412664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:40:05.412664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:40:05.412664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:40:05.412664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:40:05.412664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:40:05.412664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:40:05.412664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:40:05.412664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:40:05.412664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:40:05.412664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:40:05.412664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:40:05.412664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:40:05.412664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:40:05.412664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:40:05.412664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:40:05.413797 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:40:05.413797 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:40:05.413797 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:40:05.413797 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:40:05.413797 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:40:05.413797 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:40:05.413797 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:40:05.413797 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:40:05.413797 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:40:05.413797 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:40:05.413797 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:40:05.413797 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:40:05.413797 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:40:05.413797 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:40:05.413797 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 419/811] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:40:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:40:05.420243 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbd94d-222a-4374-89d1-519f537e2d1a None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:05.514569 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:40:05.535729 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fbd94d-222a-4374-89d1-519f537e2d1a None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:05.580113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a67913-ecea-468e-887e-226512988521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:05.580852 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a67913-ecea-468e-887e-226512988521 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:05.581138 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a67913-ecea-468e-887e-226512988521 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:05.581417 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a67913-ecea-468e-887e-226512988521 None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:05.582137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a67913-ecea-468e-887e-226512988521 None admin] RBAC: Adding query filter params (name=compute) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:40:05.582449 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a67913-ecea-468e-887e-226512988521 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:05.583913 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a67913-ecea-468e-887e-226512988521 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:05.589050 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 393/812] 10.222.0.62 () {56 vars in 1112 bytes} [Wed May 25 15:40:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:40:05.595358 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27d8d1-13f9-410f-bf00-dceb692933f8 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:05.657706 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:40:05.711091 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27d8d1-13f9-410f-bf00-dceb692933f8 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:05.745567 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b01fb-8660-466c-86fb-3cf1b3e59488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:05.746221 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b01fb-8660-466c-86fb-3cf1b3e59488 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:05.746501 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b01fb-8660-466c-86fb-3cf1b3e59488 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:05.746771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b01fb-8660-466c-86fb-3cf1b3e59488 None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:05.747465 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b01fb-8660-466c-86fb-3cf1b3e59488 None admin] RBAC: Adding query filter params (type=compute) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:40:05.747799 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b01fb-8660-466c-86fb-3cf1b3e59488 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:05.749470 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966b01fb-8660-466c-86fb-3cf1b3e59488 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:05.754144 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 420/813] 10.222.0.62 () {56 vars in 1112 bytes} [Wed May 25 15:40:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:40:05.760227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a67913-ecea-468e-887e-226512988521 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:05.862019 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a67913-ecea-468e-887e-226512988521 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:05.895351 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb8f402-bff9-4d4d-bf35-dbac83958f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:05.896004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8f402-bff9-4d4d-bf35-dbac83958f10 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:05.896286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8f402-bff9-4d4d-bf35-dbac83958f10 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:05.896593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb8f402-bff9-4d4d-bf35-dbac83958f10 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:05.897375 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8f402-bff9-4d4d-bf35-dbac83958f10 None admin] RBAC: Adding query filter params (interface=public, service_id=a6b169918f6a43daab8e2778abbba4a9, region_id=RegionOne) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:40:05.897684 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8f402-bff9-4d4d-bf35-dbac83958f10 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:05.899045 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb8f402-bff9-4d4d-bf35-dbac83958f10 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:05.904953 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 394/814] 10.222.0.62 () {56 vars in 1251 bytes} [Wed May 25 15:40:05 2022] GET /identity/v3/endpoints?service_id=a6b169918f6a43daab8e2778abbba4a9&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:40:05.910702 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b01fb-8660-466c-86fb-3cf1b3e59488 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:06.010591 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966b01fb-8660-466c-86fb-3cf1b3e59488 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:06.027537 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:40:06.045241 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66621e7e-eccd-43dc-a43c-bf9455d311cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:06.045908 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66621e7e-eccd-43dc-a43c-bf9455d311cb None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:06.046190 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66621e7e-eccd-43dc-a43c-bf9455d311cb None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:06.046465 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66621e7e-eccd-43dc-a43c-bf9455d311cb None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:06.047143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66621e7e-eccd-43dc-a43c-bf9455d311cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:06.049516 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66621e7e-eccd-43dc-a43c-bf9455d311cb None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:06.054818 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 421/815] 10.222.0.62 () {56 vars in 1087 bytes} [Wed May 25 15:40:05 2022] GET /identity/v3/services => generated 1728 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:40:08.331324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659204b9-76a8-4aa3-8524-79be46236eaf None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:08.331847 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659204b9-76a8-4aa3-8524-79be46236eaf None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:08.331847 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659204b9-76a8-4aa3-8524-79be46236eaf None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:08.333263 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 395/816] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:40:08.338566 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c32bd-f0f2-4ecf-88e2-8dd3c3f82c31 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:08.338995 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c32bd-f0f2-4ecf-88e2-8dd3c3f82c31 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:08.339174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678c32bd-f0f2-4ecf-88e2-8dd3c3f82c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:08.356247 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-678c32bd-f0f2-4ecf-88e2-8dd3c3f82c31 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:40:08.358083 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-678c32bd-f0f2-4ecf-88e2-8dd3c3f82c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:40:08.424609 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 422/817] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:40:08 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 15:40:08.449342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659204b9-76a8-4aa3-8524-79be46236eaf None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:08.461066 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:40:08.551026 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659204b9-76a8-4aa3-8524-79be46236eaf None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:08.584922 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670d9b2-90ee-48da-b99c-f6184ef7844e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:08.585707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670d9b2-90ee-48da-b99c-f6184ef7844e None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:08.585996 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670d9b2-90ee-48da-b99c-f6184ef7844e None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:08.586277 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a670d9b2-90ee-48da-b99c-f6184ef7844e None admin] PATH_INFO: `/v3/services/compute` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:08.586925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670d9b2-90ee-48da-b99c-f6184ef7844e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:08.588292 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a670d9b2-90ee-48da-b99c-f6184ef7844e None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:08.600157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-a670d9b2-90ee-48da-b99c-f6184ef7844e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:40:08.600157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:40:08.600157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:40:08.600157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:40:08.600157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:40:08.600157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:40:08.600157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:40:08.600157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:40:08.600157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:40:08.600157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:40:08.600157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:40:08.600157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:40:08.600157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:40:08.600157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:40:08.600157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:40:08.600157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:40:08.600157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:40:08.601377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:40:08.601377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:40:08.601377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:40:08.601377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:40:08.601377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:40:08.601377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:40:08.601377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:40:08.601377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:40:08.601377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:40:08.601377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:40:08.601377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:40:08.601377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:40:08.601377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:40:08.601377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:40:08.601377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:40:08.601377 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:40:08.602418 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:40:08.602418 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:40:08.602418 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:40:08.602418 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:40:08.602418 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:40:08.602418 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:40:08.602418 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:40:08.602418 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:40:08.602418 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:40:08.602418 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:40:08.602418 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:40:08.602418 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:40:08.602418 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 15:40:08.602418 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:40:08.602418 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 396/818] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:40:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:40:08.608801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c32bd-f0f2-4ecf-88e2-8dd3c3f82c31 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:08.707436 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678c32bd-f0f2-4ecf-88e2-8dd3c3f82c31 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:08.718408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:40:08.742056 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88989e31-fbe5-43b9-a2de-e9f873617253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:08.742715 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88989e31-fbe5-43b9-a2de-e9f873617253 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:08.743021 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88989e31-fbe5-43b9-a2de-e9f873617253 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:08.743279 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88989e31-fbe5-43b9-a2de-e9f873617253 None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:08.743976 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88989e31-fbe5-43b9-a2de-e9f873617253 None admin] RBAC: Adding query filter params (name=compute) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:40:08.744284 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88989e31-fbe5-43b9-a2de-e9f873617253 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:08.745681 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88989e31-fbe5-43b9-a2de-e9f873617253 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:08.751153 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 423/819] 10.222.0.62 () {56 vars in 1112 bytes} [Wed May 25 15:40:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:40:08.756987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670d9b2-90ee-48da-b99c-f6184ef7844e None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:08.826323 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:40:08.854908 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a670d9b2-90ee-48da-b99c-f6184ef7844e None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:08.888602 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8a8d3b-2186-4897-8e75-a5d5fd95444b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:08.889251 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a8d3b-2186-4897-8e75-a5d5fd95444b None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:08.889536 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a8d3b-2186-4897-8e75-a5d5fd95444b None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:08.889817 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8a8d3b-2186-4897-8e75-a5d5fd95444b None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:08.890518 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a8d3b-2186-4897-8e75-a5d5fd95444b None admin] RBAC: Adding query filter params (type=compute) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:40:08.890821 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a8d3b-2186-4897-8e75-a5d5fd95444b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:08.892193 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8a8d3b-2186-4897-8e75-a5d5fd95444b None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:08.897558 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 397/820] 10.222.0.62 () {56 vars in 1112 bytes} [Wed May 25 15:40:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:40:08.903285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88989e31-fbe5-43b9-a2de-e9f873617253 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:40:09.005220 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88989e31-fbe5-43b9-a2de-e9f873617253 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:40:09.039669 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24562823-15ad-4104-952a-ea55a433ebe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:40:09.040327 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24562823-15ad-4104-952a-ea55a433ebe4 None admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:40:09.040642 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24562823-15ad-4104-952a-ea55a433ebe4 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:40:09.040924 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24562823-15ad-4104-952a-ea55a433ebe4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:40:09.041662 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24562823-15ad-4104-952a-ea55a433ebe4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:40:09.043036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24562823-15ad-4104-952a-ea55a433ebe4 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:40:09.148402 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 424/821] 10.222.0.62 () {60 vars in 1144 bytes} [Wed May 25 15:40:08 2022] POST /identity/v3/endpoints => generated 334 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:40:18.894991 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=32 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:40:19.140230 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=84,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:33.397562 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba9936-d934-4911-a991-8546614986b8 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:33.398124 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba9936-d934-4911-a991-8546614986b8 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:33.398228 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ba9936-d934-4911-a991-8546614986b8 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:33.399605 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 398/822] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:41:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:41:33.405411 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e0dbb-45f4-4d37-aa9d-3e650acd93a4 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:33.405883 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e0dbb-45f4-4d37-aa9d-3e650acd93a4 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:33.405981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e0dbb-45f4-4d37-aa9d-3e650acd93a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:33.422725 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-d60e0dbb-45f4-4d37-aa9d-3e650acd93a4 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:33.423910 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-d60e0dbb-45f4-4d37-aa9d-3e650acd93a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:33.496802 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 425/823] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:41:33 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:41:33.524540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba9936-d934-4911-a991-8546614986b8 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:33.627495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ba9936-d934-4911-a991-8546614986b8 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:33.661870 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc26d46-672a-4811-81af-e6c699656fd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:33.663216 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc26d46-672a-4811-81af-e6c699656fd5 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:33.663600 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc26d46-672a-4811-81af-e6c699656fd5 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:33.663885 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc26d46-672a-4811-81af-e6c699656fd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:33.674393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc26d46-672a-4811-81af-e6c699656fd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:33.675844 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc26d46-672a-4811-81af-e6c699656fd5 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:33.694449 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-cbc26d46-672a-4811-81af-e6c699656fd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:33.694449 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:33.694449 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:33.694449 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:33.694449 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:33.694449 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:33.694449 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:33.694449 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:33.694449 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:33.694449 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:33.694449 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:33.694449 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:33.694449 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:41:33.694449 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:41:33.694449 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:41:33.698894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:41:33.698894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:33.698894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:33.698894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:33.698894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:33.698894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:33.698894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:33.698894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:33.698894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:41:33.698894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:33.698894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:33.698894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:33.698894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:33.698894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:33.698894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:33.698894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:33.698894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:33.700103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:41:33.700103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:41:33.700103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:33.700103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:41:33.700103 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 399/824] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:41:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:33.701744 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e0dbb-45f4-4d37-aa9d-3e650acd93a4 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:33.802015 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e0dbb-45f4-4d37-aa9d-3e650acd93a4 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:33.829852 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:33.839481 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078242d-5c00-4041-977d-1d78823bffd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:33.840149 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078242d-5c00-4041-977d-1d78823bffd6 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:33.840462 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078242d-5c00-4041-977d-1d78823bffd6 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:33.840744 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078242d-5c00-4041-977d-1d78823bffd6 None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:33.841465 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078242d-5c00-4041-977d-1d78823bffd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:33.841774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078242d-5c00-4041-977d-1d78823bffd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:33.843294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6078242d-5c00-4041-977d-1d78823bffd6 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:33.855638 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 426/825] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:41:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:33.862755 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc26d46-672a-4811-81af-e6c699656fd5 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:33.918872 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:33.967760 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc26d46-672a-4811-81af-e6c699656fd5 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:34.000552 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316a5ff6-009f-4524-b258-b5e65b04dd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:34.001216 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a5ff6-009f-4524-b258-b5e65b04dd7c None admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:34.001501 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a5ff6-009f-4524-b258-b5e65b04dd7c None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:34.001782 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316a5ff6-009f-4524-b258-b5e65b04dd7c None admin] PATH_INFO: `/v3/users` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:34.002480 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a5ff6-009f-4524-b258-b5e65b04dd7c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:34.003905 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316a5ff6-009f-4524-b258-b5e65b04dd7c None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:34.143546 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 400/826] 10.222.0.62 () {60 vars in 1132 bytes} [Wed May 25 15:41:33 2022] POST /identity/v3/users => generated 251 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:41:36.494578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd960b-69ff-4794-9673-af17e8197cc1 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:36.495084 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd960b-69ff-4794-9673-af17e8197cc1 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:36.495172 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd960b-69ff-4794-9673-af17e8197cc1 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:36.496562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 427/827] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:41:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:41:36.502052 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ac37f-d66c-4526-85f6-8341e67cb149 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:36.502466 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ac37f-d66c-4526-85f6-8341e67cb149 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:36.502606 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ac37f-d66c-4526-85f6-8341e67cb149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:36.520513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-891ac37f-d66c-4526-85f6-8341e67cb149 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:36.521748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-891ac37f-d66c-4526-85f6-8341e67cb149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:36.591513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 401/828] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:41:36 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:41:36.618839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd960b-69ff-4794-9673-af17e8197cc1 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:36.723344 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd960b-69ff-4794-9673-af17e8197cc1 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:36.758965 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e3b98-b5c2-4a54-bcfe-1aad9b05ad31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:36.759695 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e3b98-b5c2-4a54-bcfe-1aad9b05ad31 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:36.759979 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e3b98-b5c2-4a54-bcfe-1aad9b05ad31 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:36.760253 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e3b98-b5c2-4a54-bcfe-1aad9b05ad31 None admin] PATH_INFO: `/v3/roles/service` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:36.771031 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e3b98-b5c2-4a54-bcfe-1aad9b05ad31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:41:36.778783 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-ff3e3b98-b5c2-4a54-bcfe-1aad9b05ad31 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:41:36.778783 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:36.778783 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:36.778783 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:36.778783 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:36.778783 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:36.778783 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:36.778783 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:36.778783 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:36.778783 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:36.778783 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:36.778783 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:36.778783 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:41:36.778783 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:41:36.778783 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:41:36.778783 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:41:36.779991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:41:36.779991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:41:36.779991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:41:36.779991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:41:36.779991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:36.779991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:36.779991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:36.779991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:36.779991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:36.779991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:36.779991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:36.779991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:41:36.779991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:36.779991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:36.779991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:36.779991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:36.781009 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:36.781009 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:36.781009 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:36.781009 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:36.781009 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:41:36.781009 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:41:36.781009 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:41:36.781009 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:41:36.781009 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:41:36.781009 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:41:36.781009 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:41:36.781009 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:41:36.781009 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 428/829] 10.222.0.62 () {56 vars in 1102 bytes} [Wed May 25 15:41:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:41:36.786138 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ac37f-d66c-4526-85f6-8341e67cb149 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:36.826647 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:36.887082 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ac37f-d66c-4526-85f6-8341e67cb149 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:36.921573 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f1685-b005-4f5c-a651-8875bbd55db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:36.922240 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f1685-b005-4f5c-a651-8875bbd55db9 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:36.922526 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f1685-b005-4f5c-a651-8875bbd55db9 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:36.922836 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6f1685-b005-4f5c-a651-8875bbd55db9 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:36.923582 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f1685-b005-4f5c-a651-8875bbd55db9 None admin] RBAC: Adding query filter params (name=service) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:36.923933 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f1685-b005-4f5c-a651-8875bbd55db9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:36.925339 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6f1685-b005-4f5c-a651-8875bbd55db9 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:36.934008 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 402/830] 10.222.0.62 () {56 vars in 1103 bytes} [Wed May 25 15:41:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:36.939790 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e3b98-b5c2-4a54-bcfe-1aad9b05ad31 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:36.987819 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:37.042256 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e3b98-b5c2-4a54-bcfe-1aad9b05ad31 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:37.075458 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c97efe-6230-4087-b43a-8aec7464f1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:37.076251 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c97efe-6230-4087-b43a-8aec7464f1fe None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:37.076568 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c97efe-6230-4087-b43a-8aec7464f1fe None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:37.076846 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c97efe-6230-4087-b43a-8aec7464f1fe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:37.088092 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c97efe-6230-4087-b43a-8aec7464f1fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:37.089818 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c97efe-6230-4087-b43a-8aec7464f1fe None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:37.107747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-c5c97efe-6230-4087-b43a-8aec7464f1fe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:37.107747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:37.107747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:37.107747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:37.107747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:37.107747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:37.107747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:37.107747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:37.107747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:37.107747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:37.107747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:37.107747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:37.107747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:41:37.107747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:41:37.107747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:41:37.108697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:41:37.108697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:37.108697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:37.108697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:37.108697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:37.108697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:37.108697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:37.108697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:37.108697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:41:37.108697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:37.108697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:37.108697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:37.108697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:37.108697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:37.108697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:37.108697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:37.108697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:37.109600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:41:37.109600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:41:37.109600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:37.109600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:41:37.109600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 429/831] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:41:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:37.114927 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f1685-b005-4f5c-a651-8875bbd55db9 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:37.213128 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:37.216143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6f1685-b005-4f5c-a651-8875bbd55db9 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:37.251275 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f3653-a796-4da6-8ac4-41375c6140ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:37.251935 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f3653-a796-4da6-8ac4-41375c6140ca None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:37.252222 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f3653-a796-4da6-8ac4-41375c6140ca None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:37.252533 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f3653-a796-4da6-8ac4-41375c6140ca None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:37.253256 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f3653-a796-4da6-8ac4-41375c6140ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:37.253565 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f3653-a796-4da6-8ac4-41375c6140ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:37.254937 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876f3653-a796-4da6-8ac4-41375c6140ca None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:37.268336 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 403/832] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:41:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:37.275249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c97efe-6230-4087-b43a-8aec7464f1fe None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:37.375463 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:37.379198 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c97efe-6230-4087-b43a-8aec7464f1fe None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:37.423135 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf92063-5831-41e4-8fe2-48f05156ca88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:37.423942 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf92063-5831-41e4-8fe2-48f05156ca88 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:37.424229 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf92063-5831-41e4-8fe2-48f05156ca88 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:37.424538 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf92063-5831-41e4-8fe2-48f05156ca88 None admin] PATH_INFO: `/v3/users/placement` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:37.432362 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf92063-5831-41e4-8fe2-48f05156ca88 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:37.433827 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf92063-5831-41e4-8fe2-48f05156ca88 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:37.448578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-fbf92063-5831-41e4-8fe2-48f05156ca88 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 15:41:37.448578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:37.448578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:37.448578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:37.448578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:37.448578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:37.448578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:37.448578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:37.448578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:37.448578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:37.448578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:37.448578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:37.448578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:41:37.448578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:41:37.448578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:41:37.448578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:41:37.449500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:37.449500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:37.449500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:41:37.449500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:41:37.449500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:41:37.449500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:41:37.449500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:37.449500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:37.449500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:37.449500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:37.449500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:37.449500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:41:37.449500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:37.449500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:37.449500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:37.449500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:37.449500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:37.449500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:37.450453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:37.450453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:37.450453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:41:37.450453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:41:37.450453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:41:37.450453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:41:37.450453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:41:37.450453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:41:37.450453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 15:41:37.450453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:41:37.450453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 430/833] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:41:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:37.455639 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f3653-a796-4da6-8ac4-41375c6140ca None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:37.556089 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876f3653-a796-4da6-8ac4-41375c6140ca None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:37.590625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c0df1-41ff-4843-8ccc-bf2dc5a6c872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:37.591295 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c0df1-41ff-4843-8ccc-bf2dc5a6c872 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:37.591580 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c0df1-41ff-4843-8ccc-bf2dc5a6c872 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:37.591856 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5c0df1-41ff-4843-8ccc-bf2dc5a6c872 None admin] PATH_INFO: `/v3/users` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:37.592716 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c0df1-41ff-4843-8ccc-bf2dc5a6c872 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:37.593025 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c0df1-41ff-4843-8ccc-bf2dc5a6c872 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:37.594495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5c0df1-41ff-4843-8ccc-bf2dc5a6c872 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:37.612617 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 404/834] 10.222.0.62 () {56 vars in 1143 bytes} [Wed May 25 15:41:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:37.618430 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf92063-5831-41e4-8fe2-48f05156ca88 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:37.722876 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf92063-5831-41e4-8fe2-48f05156ca88 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:37.755433 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70828dd6-ed08-4d38-bb71-0d2398dd2188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:37.756086 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70828dd6-ed08-4d38-bb71-0d2398dd2188 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:37.756367 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70828dd6-ed08-4d38-bb71-0d2398dd2188 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:37.756670 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70828dd6-ed08-4d38-bb71-0d2398dd2188 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:37.786664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:37.826443 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70828dd6-ed08-4d38-bb71-0d2398dd2188 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:37.827926 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70828dd6-ed08-4d38-bb71-0d2398dd2188 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:37.928145 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 431/835] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:41:37 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:41:37.934831 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c0df1-41ff-4843-8ccc-bf2dc5a6c872 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:37.953977 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:38.037219 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5c0df1-41ff-4843-8ccc-bf2dc5a6c872 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:38.071763 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63638e99-27be-4d9e-bd64-0bfe5402c50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:38.072580 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63638e99-27be-4d9e-bd64-0bfe5402c50d None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:38.072867 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63638e99-27be-4d9e-bd64-0bfe5402c50d None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:38.073147 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63638e99-27be-4d9e-bd64-0bfe5402c50d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:38.083535 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63638e99-27be-4d9e-bd64-0bfe5402c50d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:38.085011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63638e99-27be-4d9e-bd64-0bfe5402c50d None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:38.103638 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-63638e99-27be-4d9e-bd64-0bfe5402c50d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:38.103638 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:38.103638 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:38.103638 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:38.103638 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:38.103638 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:38.103638 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:38.103638 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:38.103638 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:38.103638 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:38.103638 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:38.103638 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:38.103638 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:41:38.103638 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:41:38.103638 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:41:38.104987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:41:38.104987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:38.104987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:38.104987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:38.104987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:38.104987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:38.104987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:38.104987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:38.104987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:41:38.104987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:38.104987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:38.104987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:38.104987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:38.104987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:38.104987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:38.104987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:38.104987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:38.106243 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:41:38.106243 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:41:38.106243 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:38.106243 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:41:38.106243 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 405/836] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:41:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:41:38.110687 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70828dd6-ed08-4d38-bb71-0d2398dd2188 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:38.170787 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:38.212057 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70828dd6-ed08-4d38-bb71-0d2398dd2188 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:38.246634 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e30d5d-caf1-498f-9b6d-9218c43e8dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:38.247282 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e30d5d-caf1-498f-9b6d-9218c43e8dd8 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:38.247562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e30d5d-caf1-498f-9b6d-9218c43e8dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:38.247833 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e30d5d-caf1-498f-9b6d-9218c43e8dd8 None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:38.248619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e30d5d-caf1-498f-9b6d-9218c43e8dd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:38.248918 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e30d5d-caf1-498f-9b6d-9218c43e8dd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:38.250311 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e30d5d-caf1-498f-9b6d-9218c43e8dd8 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:38.261516 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 432/837] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:41:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:38.267441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63638e99-27be-4d9e-bd64-0bfe5402c50d None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:38.337561 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:38.370514 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63638e99-27be-4d9e-bd64-0bfe5402c50d None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:38.406597 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf91b86-3fde-460a-8a26-010f1a741569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:38.407399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf91b86-3fde-460a-8a26-010f1a741569 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:38.407689 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf91b86-3fde-460a-8a26-010f1a741569 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:38.407971 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf91b86-3fde-460a-8a26-010f1a741569 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:38.415842 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf91b86-3fde-460a-8a26-010f1a741569 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:38.417326 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf91b86-3fde-460a-8a26-010f1a741569 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:38.432203 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-dcf91b86-3fde-460a-8a26-010f1a741569 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:41:38.432203 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:38.432203 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:38.432203 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:38.432203 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:38.432203 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:38.432203 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:38.432203 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:38.432203 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:38.432203 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:38.432203 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:38.432203 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:38.432203 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:41:38.432203 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:41:38.432203 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:41:38.433451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:41:38.433451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:38.433451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:38.433451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:38.433451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:38.433451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:38.433451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:38.433451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:38.433451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:41:38.433451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:38.433451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:38.433451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:38.433451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:38.433451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:38.433451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:38.433451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:38.433451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:38.434593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:41:38.434593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:41:38.434593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:41:38.434593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:41:38.434593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:41:38.434593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:41:38.434593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:41:38.434593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:41:38.434593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 406/838] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:41:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:38.439478 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e30d5d-caf1-498f-9b6d-9218c43e8dd8 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:38.542691 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e30d5d-caf1-498f-9b6d-9218c43e8dd8 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:38.560247 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:38.577552 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21009a6-4298-4a37-bbeb-9814edc69a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:38.578219 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21009a6-4298-4a37-bbeb-9814edc69a50 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:38.578508 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21009a6-4298-4a37-bbeb-9814edc69a50 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:38.578787 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21009a6-4298-4a37-bbeb-9814edc69a50 None admin] PATH_INFO: `/v3/projects` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:38.579567 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21009a6-4298-4a37-bbeb-9814edc69a50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:38.579878 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21009a6-4298-4a37-bbeb-9814edc69a50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:38.581438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21009a6-4298-4a37-bbeb-9814edc69a50 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:38.594833 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 433/839] 10.222.0.62 () {56 vars in 1148 bytes} [Wed May 25 15:41:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:38.601654 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf91b86-3fde-460a-8a26-010f1a741569 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:38.701291 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf91b86-3fde-460a-8a26-010f1a741569 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:38.730755 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:38.736651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c360e5e5-850a-4010-ad2e-cb0ca38b0cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:38.737330 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360e5e5-850a-4010-ad2e-cb0ca38b0cdd None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:38.737617 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360e5e5-850a-4010-ad2e-cb0ca38b0cdd None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:38.737890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c360e5e5-850a-4010-ad2e-cb0ca38b0cdd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:38.738703 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360e5e5-850a-4010-ad2e-cb0ca38b0cdd None admin] RBAC: Adding query filter params (role.id=d1d28f6c8cb34e9f8af7cda9d128a351, scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5, user.id=2506613903044131b9e8c75196de862b) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:38.739012 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360e5e5-850a-4010-ad2e-cb0ca38b0cdd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:38.740451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c360e5e5-850a-4010-ad2e-cb0ca38b0cdd None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:38.746034 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 407/840] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:41:38 2022] GET /identity/v3/role_assignments?user.id=2506613903044131b9e8c75196de862b&scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5&role.id=d1d28f6c8cb34e9f8af7cda9d128a351 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:40.990800 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99e796-9d70-4944-991b-7cb23cf2ca66 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:40.991355 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99e796-9d70-4944-991b-7cb23cf2ca66 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:40.991355 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d99e796-9d70-4944-991b-7cb23cf2ca66 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:40.993416 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 434/841] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:41:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:41:41.002210 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2589acd-ed4b-46d5-b51e-7e161760c724 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:41.002210 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2589acd-ed4b-46d5-b51e-7e161760c724 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:41.002210 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2589acd-ed4b-46d5-b51e-7e161760c724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:41.019262 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-b2589acd-ed4b-46d5-b51e-7e161760c724 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:41.020569 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-b2589acd-ed4b-46d5-b51e-7e161760c724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:41.089442 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 408/842] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:41:40 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:41:41.114185 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99e796-9d70-4944-991b-7cb23cf2ca66 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:41.219184 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d99e796-9d70-4944-991b-7cb23cf2ca66 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:41.253362 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85715418-0654-4a0c-b263-02f847f23fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:41.254092 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85715418-0654-4a0c-b263-02f847f23fdf None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:41.254373 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85715418-0654-4a0c-b263-02f847f23fdf None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:41.254646 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85715418-0654-4a0c-b263-02f847f23fdf None admin] PATH_INFO: `/v3/roles/service` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:41.265122 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85715418-0654-4a0c-b263-02f847f23fdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:41:41.273093 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-85715418-0654-4a0c-b263-02f847f23fdf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:41:41.273093 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:41.273093 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:41.273093 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:41.273093 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:41.273093 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:41.273093 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:41.273093 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:41.273093 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:41.273093 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:41.273093 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:41.273093 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:41.273093 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:41:41.273093 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:41:41.273093 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:41:41.273093 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:41:41.274239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:41:41.274239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:41:41.274239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:41:41.274239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:41:41.274239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:41.274239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:41.274239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:41.274239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:41.274239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:41.274239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:41.274239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:41.274239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:41:41.274239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:41.274239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:41.274239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:41.274239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:41.275116 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:41.275116 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:41.275116 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:41.275116 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:41.275116 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:41:41.275116 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:41:41.275116 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:41:41.275116 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:41:41.275116 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:41:41.275116 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:41:41.275116 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:41:41.275116 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:41:41.275116 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 435/843] 10.222.0.62 () {56 vars in 1102 bytes} [Wed May 25 15:41:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:41.280406 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2589acd-ed4b-46d5-b51e-7e161760c724 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:41.381384 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2589acd-ed4b-46d5-b51e-7e161760c724 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:41.406256 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:41.418214 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bc6fc-e77d-40ba-aca8-040f52c02ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:41.418889 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bc6fc-e77d-40ba-aca8-040f52c02ca7 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:41.419176 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bc6fc-e77d-40ba-aca8-040f52c02ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:41.419456 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bc6fc-e77d-40ba-aca8-040f52c02ca7 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:41.420201 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bc6fc-e77d-40ba-aca8-040f52c02ca7 None admin] RBAC: Adding query filter params (name=service) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:41.420615 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bc6fc-e77d-40ba-aca8-040f52c02ca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:41.422020 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17bc6fc-e77d-40ba-aca8-040f52c02ca7 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:41.430806 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 409/844] 10.222.0.62 () {56 vars in 1103 bytes} [Wed May 25 15:41:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:41.438203 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85715418-0654-4a0c-b263-02f847f23fdf None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:41.479854 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:41.540580 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85715418-0654-4a0c-b263-02f847f23fdf None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:41.573034 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea5b60-6f4f-4840-a478-d00fa8b1148a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:41.573819 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea5b60-6f4f-4840-a478-d00fa8b1148a None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:41.574098 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea5b60-6f4f-4840-a478-d00fa8b1148a None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:41.574370 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ea5b60-6f4f-4840-a478-d00fa8b1148a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:41.585914 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea5b60-6f4f-4840-a478-d00fa8b1148a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:41.587519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ea5b60-6f4f-4840-a478-d00fa8b1148a None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:41.604850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-b9ea5b60-6f4f-4840-a478-d00fa8b1148a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:41.604850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:41.604850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:41.604850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:41.604850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:41.604850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:41.604850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:41.604850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:41.604850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:41.604850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:41.604850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:41.604850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:41.604850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:41:41.604850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:41:41.604850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:41:41.605960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:41:41.605960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:41.605960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:41.605960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:41.605960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:41.605960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:41.605960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:41.605960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:41.605960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:41:41.605960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:41.605960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:41.605960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:41.605960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:41.605960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:41.605960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:41.605960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:41.605960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:41.606939 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:41:41.606939 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:41:41.606939 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:41.606939 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:41:41.606939 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 436/845] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:41:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:41.611827 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bc6fc-e77d-40ba-aca8-040f52c02ca7 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:41.716898 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bc6fc-e77d-40ba-aca8-040f52c02ca7 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:41.751599 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5816a7a-6609-481f-89fb-9a530b2e9eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:41.752327 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5816a7a-6609-481f-89fb-9a530b2e9eeb None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:41.752645 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5816a7a-6609-481f-89fb-9a530b2e9eeb None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:41.752926 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5816a7a-6609-481f-89fb-9a530b2e9eeb None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:41.753799 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5816a7a-6609-481f-89fb-9a530b2e9eeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:41.754110 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5816a7a-6609-481f-89fb-9a530b2e9eeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:41.755483 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5816a7a-6609-481f-89fb-9a530b2e9eeb None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:41.769922 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 410/846] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:41.776268 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea5b60-6f4f-4840-a478-d00fa8b1148a None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:41.867129 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:41.876597 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ea5b60-6f4f-4840-a478-d00fa8b1148a None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:41.911095 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6337c-74da-4d90-87a5-20dca41ef558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:41.911892 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6337c-74da-4d90-87a5-20dca41ef558 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:41.912175 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6337c-74da-4d90-87a5-20dca41ef558 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:41.912475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee6337c-74da-4d90-87a5-20dca41ef558 None admin] PATH_INFO: `/v3/users/placement` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:41.920027 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6337c-74da-4d90-87a5-20dca41ef558 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:41.921496 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee6337c-74da-4d90-87a5-20dca41ef558 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:41.936838 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-cee6337c-74da-4d90-87a5-20dca41ef558 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 15:41:41.936838 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:41.936838 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:41.936838 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:41.936838 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:41.936838 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:41.936838 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:41.936838 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:41.936838 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:41.936838 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:41.936838 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:41.936838 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:41.936838 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:41:41.936838 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:41:41.936838 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:41:41.936838 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:41:41.943519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:41.943519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:41.943519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:41:41.943519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:41:41.943519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:41:41.943519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:41:41.943519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:41.943519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:41.943519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:41.943519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:41.943519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:41.943519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:41:41.943519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:41.943519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:41.943519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:41.943519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:41.943519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:41.943519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:41.944592 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:41.944592 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:41.944592 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:41:41.944592 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:41:41.944592 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:41:41.944592 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:41:41.944592 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:41:41.944592 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:41:41.944592 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 15:41:41.944592 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:41:41.944592 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 437/847] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:41:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:41.945859 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5816a7a-6609-481f-89fb-9a530b2e9eeb None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:41.992392 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:42.046318 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5816a7a-6609-481f-89fb-9a530b2e9eeb None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:42.081569 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5ea8e-7668-4b30-9e85-d2aa8d3177c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:42.082238 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5ea8e-7668-4b30-9e85-d2aa8d3177c3 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:42.082528 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5ea8e-7668-4b30-9e85-d2aa8d3177c3 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:42.082808 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e5ea8e-7668-4b30-9e85-d2aa8d3177c3 None admin] PATH_INFO: `/v3/users` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:42.083713 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5ea8e-7668-4b30-9e85-d2aa8d3177c3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:42.084043 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5ea8e-7668-4b30-9e85-d2aa8d3177c3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:42.085576 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e5ea8e-7668-4b30-9e85-d2aa8d3177c3 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:42.102810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 411/848] 10.222.0.62 () {56 vars in 1143 bytes} [Wed May 25 15:41:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:42.108897 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6337c-74da-4d90-87a5-20dca41ef558 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:42.209633 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee6337c-74da-4d90-87a5-20dca41ef558 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:42.243519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3459e-0d60-4372-a065-b8bdc21f63da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:42.244303 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3459e-0d60-4372-a065-b8bdc21f63da None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:42.244619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3459e-0d60-4372-a065-b8bdc21f63da None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:42.244895 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3459e-0d60-4372-a065-b8bdc21f63da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:42.255037 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3459e-0d60-4372-a065-b8bdc21f63da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:42.256489 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3459e-0d60-4372-a065-b8bdc21f63da None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:42.275839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-d1b3459e-0d60-4372-a065-b8bdc21f63da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:42.275839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:42.275839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:42.275839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:42.275839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:42.275839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:42.275839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:42.275839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:42.275839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:42.275839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:42.275839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:42.275839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:42.275839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:41:42.275839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:41:42.275839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:41:42.276923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:41:42.276923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:42.276923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:42.276923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:42.276923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:42.276923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:42.276923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:42.276923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:42.276923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:41:42.276923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:42.276923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:42.276923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:42.276923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:42.276923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:42.276923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:42.276923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:42.276923 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:42.278063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:41:42.278063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:41:42.278063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:42.278063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:41:42.278063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 438/849] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:41:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:42.282810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5ea8e-7668-4b30-9e85-d2aa8d3177c3 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:42.385419 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e5ea8e-7668-4b30-9e85-d2aa8d3177c3 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:42.387716 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:42.418639 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c63b50-f1a8-4bff-8aee-5b07a947e07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:42.419298 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c63b50-f1a8-4bff-8aee-5b07a947e07a None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:42.419648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c63b50-f1a8-4bff-8aee-5b07a947e07a None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:42.419921 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c63b50-f1a8-4bff-8aee-5b07a947e07a None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:42.420665 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c63b50-f1a8-4bff-8aee-5b07a947e07a None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:42.420975 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c63b50-f1a8-4bff-8aee-5b07a947e07a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:42.422351 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c63b50-f1a8-4bff-8aee-5b07a947e07a None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:42.433908 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 412/850] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:41:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:41:42.439504 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3459e-0d60-4372-a065-b8bdc21f63da None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:42.445362 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:42.539362 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3459e-0d60-4372-a065-b8bdc21f63da None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:42.573362 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d389442-23bf-496a-81a7-3610632dd1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:42.574152 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d389442-23bf-496a-81a7-3610632dd1fb None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:42.574433 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d389442-23bf-496a-81a7-3610632dd1fb None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:42.574705 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d389442-23bf-496a-81a7-3610632dd1fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:42.581666 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d389442-23bf-496a-81a7-3610632dd1fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:42.583163 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d389442-23bf-496a-81a7-3610632dd1fb None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:42.597584 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-9d389442-23bf-496a-81a7-3610632dd1fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:41:42.597584 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:42.597584 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:42.597584 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:42.597584 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:42.597584 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:42.597584 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:42.597584 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:42.597584 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:42.597584 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:42.597584 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:42.597584 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:42.597584 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:41:42.597584 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:41:42.597584 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:41:42.598638 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:41:42.598638 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:42.598638 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:42.598638 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:42.598638 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:42.598638 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:42.598638 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:42.598638 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:42.598638 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:41:42.598638 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:42.598638 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:42.598638 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:42.598638 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:42.598638 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:42.598638 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:42.598638 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:42.598638 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:42.599628 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:41:42.599628 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:41:42.599628 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:41:42.599628 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:41:42.599628 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:41:42.599628 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:41:42.599628 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:41:42.599628 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:41:42.599628 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 439/851] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:41:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:42.605803 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c63b50-f1a8-4bff-8aee-5b07a947e07a None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:42.707909 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c63b50-f1a8-4bff-8aee-5b07a947e07a None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:42.742421 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cda67fd-d734-4bc6-997d-b41cfcae4c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:42.743078 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda67fd-d734-4bc6-997d-b41cfcae4c39 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:42.743365 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda67fd-d734-4bc6-997d-b41cfcae4c39 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:42.743643 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cda67fd-d734-4bc6-997d-b41cfcae4c39 None admin] PATH_INFO: `/v3/projects` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:42.744439 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda67fd-d734-4bc6-997d-b41cfcae4c39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:42.744753 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda67fd-d734-4bc6-997d-b41cfcae4c39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:42.746186 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cda67fd-d734-4bc6-997d-b41cfcae4c39 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:42.758799 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 413/852] 10.222.0.62 () {56 vars in 1148 bytes} [Wed May 25 15:41:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:41:42.764963 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d389442-23bf-496a-81a7-3610632dd1fb None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:42.827807 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:42.866283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d389442-23bf-496a-81a7-3610632dd1fb None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:42.902590 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932b77e6-5d50-43dc-b1b2-b533460a7772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:42.903453 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b77e6-5d50-43dc-b1b2-b533460a7772 None admin] REQUEST_METHOD: `PUT` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:42.903731 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b77e6-5d50-43dc-b1b2-b533460a7772 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:42.903998 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932b77e6-5d50-43dc-b1b2-b533460a7772 None admin] PATH_INFO: `/v3/projects/5e951a6f0d6947dfae3ac132afbcd4b5/users/2506613903044131b9e8c75196de862b/roles/d1d28f6c8cb34e9f8af7cda9d128a351` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:42.919659 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b77e6-5d50-43dc-b1b2-b533460a7772 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e951a6f0d6947dfae3ac132afbcd4b5, user_id=2506613903044131b9e8c75196de862b, role_id=d1d28f6c8cb34e9f8af7cda9d128a351)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:42.921206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932b77e6-5d50-43dc-b1b2-b533460a7772 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:43.051410 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 440/853] 10.222.0.62 () {58 vars in 1439 bytes} [Wed May 25 15:41:42 2022] PUT /identity/v3/projects/5e951a6f0d6947dfae3ac132afbcd4b5/users/2506613903044131b9e8c75196de862b/roles/d1d28f6c8cb34e9f8af7cda9d128a351 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:45.345575 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a4b88-4c28-4f87-b352-4b19cdde4725 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:45.346228 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a4b88-4c28-4f87-b352-4b19cdde4725 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:45.346228 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a4b88-4c28-4f87-b352-4b19cdde4725 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:45.347579 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 414/854] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:41:45.353343 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b54015-3010-4c38-bf1b-633b04b882eb None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:45.353794 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b54015-3010-4c38-bf1b-633b04b882eb None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:45.353891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b54015-3010-4c38-bf1b-633b04b882eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:45.370628 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-89b54015-3010-4c38-bf1b-633b04b882eb None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:45.379964 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-89b54015-3010-4c38-bf1b-633b04b882eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:45.445204 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 441/855] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:41:45 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:41:45.470738 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a4b88-4c28-4f87-b352-4b19cdde4725 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:45.497053 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:45.574075 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a4b88-4c28-4f87-b352-4b19cdde4725 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:45.607582 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eccec0-9c11-4048-b019-59d29050a21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:45.608375 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eccec0-9c11-4048-b019-59d29050a21c None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:45.608698 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eccec0-9c11-4048-b019-59d29050a21c None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:45.609041 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eccec0-9c11-4048-b019-59d29050a21c None admin] PATH_INFO: `/v3/roles/service` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:45.619636 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eccec0-9c11-4048-b019-59d29050a21c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:41:45.627393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-17eccec0-9c11-4048-b019-59d29050a21c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 15:41:45.627393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:45.627393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:45.627393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:45.627393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:45.627393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:45.627393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:45.627393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:45.627393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:45.627393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:45.627393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:45.627393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:45.627393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:41:45.627393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:41:45.627393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:41:45.627393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:41:45.628632 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:41:45.628632 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:41:45.628632 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:41:45.628632 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:41:45.628632 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:45.628632 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:45.628632 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:45.628632 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:45.628632 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:45.628632 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:45.628632 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:45.628632 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:41:45.628632 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:45.628632 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:45.628632 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:45.628632 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:45.629896 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:45.629896 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:45.629896 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:45.629896 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:45.629896 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:41:45.629896 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:41:45.629896 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:41:45.629896 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:41:45.629896 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:41:45.629896 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:41:45.629896 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 15:41:45.629896 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:41:45.629896 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 415/856] 10.222.0.62 () {56 vars in 1102 bytes} [Wed May 25 15:41:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:45.634929 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b54015-3010-4c38-bf1b-633b04b882eb None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:45.678573 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:45.737124 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b54015-3010-4c38-bf1b-633b04b882eb None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:45.769960 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90deae8d-1086-45c3-9f67-68e700635820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:45.770615 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90deae8d-1086-45c3-9f67-68e700635820 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:45.770893 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90deae8d-1086-45c3-9f67-68e700635820 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:45.771165 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90deae8d-1086-45c3-9f67-68e700635820 None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:45.771907 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90deae8d-1086-45c3-9f67-68e700635820 None admin] RBAC: Adding query filter params (name=service) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:45.772209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90deae8d-1086-45c3-9f67-68e700635820 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:45.774234 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90deae8d-1086-45c3-9f67-68e700635820 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:45.782369 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 442/857] 10.222.0.62 () {56 vars in 1103 bytes} [Wed May 25 15:41:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:45.789046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eccec0-9c11-4048-b019-59d29050a21c None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:45.872847 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:45.889247 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eccec0-9c11-4048-b019-59d29050a21c None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:45.923649 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343b491-87ab-4da6-ac9b-73ef4ee2e713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:45.924334 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343b491-87ab-4da6-ac9b-73ef4ee2e713 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:45.924645 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343b491-87ab-4da6-ac9b-73ef4ee2e713 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:45.924923 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343b491-87ab-4da6-ac9b-73ef4ee2e713 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:45.935360 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343b491-87ab-4da6-ac9b-73ef4ee2e713 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:45.936901 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343b491-87ab-4da6-ac9b-73ef4ee2e713 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:45.954536 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-f343b491-87ab-4da6-ac9b-73ef4ee2e713 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:45.954536 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:45.954536 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:45.954536 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:45.954536 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:45.954536 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:45.954536 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:45.954536 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:45.954536 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:45.954536 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:45.954536 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:45.954536 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:45.954536 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:41:45.954536 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:41:45.954536 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:41:45.955630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:41:45.955630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:45.955630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:45.955630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:45.955630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:45.955630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:45.955630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:45.955630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:45.955630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:41:45.955630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:45.955630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:45.955630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:45.955630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:45.955630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:45.955630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:45.955630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:45.955630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:45.956746 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:41:45.956746 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:41:45.956746 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:45.956746 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:41:45.956746 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 416/858] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:41:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:45.961966 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90deae8d-1086-45c3-9f67-68e700635820 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:46.065522 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90deae8d-1086-45c3-9f67-68e700635820 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:46.067919 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:46.100170 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b8286-a595-4c25-aa74-a11b691cfed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:46.100917 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b8286-a595-4c25-aa74-a11b691cfed7 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:46.101199 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b8286-a595-4c25-aa74-a11b691cfed7 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:46.101475 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b8286-a595-4c25-aa74-a11b691cfed7 None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:46.102199 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b8286-a595-4c25-aa74-a11b691cfed7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:46.102509 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b8286-a595-4c25-aa74-a11b691cfed7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:46.103874 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b8286-a595-4c25-aa74-a11b691cfed7 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:46.115173 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 443/859] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:46.121445 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343b491-87ab-4da6-ac9b-73ef4ee2e713 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:46.223327 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343b491-87ab-4da6-ac9b-73ef4ee2e713 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:46.256661 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b85531-94f2-42be-bfe5-35616ab2d092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:46.258027 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b85531-94f2-42be-bfe5-35616ab2d092 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:46.258308 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b85531-94f2-42be-bfe5-35616ab2d092 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:46.258584 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b85531-94f2-42be-bfe5-35616ab2d092 None admin] PATH_INFO: `/v3/users/placement` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:46.261265 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:46.265717 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b85531-94f2-42be-bfe5-35616ab2d092 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:46.267404 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b85531-94f2-42be-bfe5-35616ab2d092 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:46.281795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-35b85531-94f2-42be-bfe5-35616ab2d092 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 15:41:46.281795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:46.281795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:46.281795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:46.281795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:46.281795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:46.281795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:46.281795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:46.281795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:46.281795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:46.281795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:46.281795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:46.281795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:41:46.281795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:41:46.281795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:41:46.281795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:41:46.282976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:46.282976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:46.282976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:41:46.282976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:41:46.282976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:41:46.282976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:41:46.282976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:46.282976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:46.282976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:46.282976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:46.282976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:46.282976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:41:46.282976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:46.282976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:46.282976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:46.282976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:46.282976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:46.282976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:46.284119 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:46.284119 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:46.284119 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:41:46.284119 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:41:46.284119 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:41:46.284119 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:41:46.284119 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:41:46.284119 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:41:46.284119 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 15:41:46.284119 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:41:46.284119 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 417/860] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:41:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:46.289043 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b8286-a595-4c25-aa74-a11b691cfed7 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:46.394302 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b8286-a595-4c25-aa74-a11b691cfed7 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:46.430571 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4e7c6-8163-4817-b630-79ce053c1e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:46.431242 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4e7c6-8163-4817-b630-79ce053c1e7f None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:46.431528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4e7c6-8163-4817-b630-79ce053c1e7f None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:46.431815 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab4e7c6-8163-4817-b630-79ce053c1e7f None admin] PATH_INFO: `/v3/users` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:46.432901 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4e7c6-8163-4817-b630-79ce053c1e7f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:46.433216 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4e7c6-8163-4817-b630-79ce053c1e7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:46.434655 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab4e7c6-8163-4817-b630-79ce053c1e7f None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:46.452578 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 444/861] 10.222.0.62 () {56 vars in 1143 bytes} [Wed May 25 15:41:46 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:46.458497 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b85531-94f2-42be-bfe5-35616ab2d092 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:46.559825 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b85531-94f2-42be-bfe5-35616ab2d092 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:46.593935 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70112bb-58fd-4c9f-8dbd-4ba06c3140a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:46.594579 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70112bb-58fd-4c9f-8dbd-4ba06c3140a9 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:46.594858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70112bb-58fd-4c9f-8dbd-4ba06c3140a9 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:46.595131 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70112bb-58fd-4c9f-8dbd-4ba06c3140a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:46.655335 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:46.661789 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70112bb-58fd-4c9f-8dbd-4ba06c3140a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:46.663290 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70112bb-58fd-4c9f-8dbd-4ba06c3140a9 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:46.762695 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 418/862] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:41:46 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:41:46.768805 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4e7c6-8163-4817-b630-79ce053c1e7f None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:46.793414 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:46.867463 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab4e7c6-8163-4817-b630-79ce053c1e7f None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:46.902333 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35205d54-a9f5-409f-af5e-810a6bdd2b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:46.903119 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35205d54-a9f5-409f-af5e-810a6bdd2b2d None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:46.903399 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35205d54-a9f5-409f-af5e-810a6bdd2b2d None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:46.903672 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35205d54-a9f5-409f-af5e-810a6bdd2b2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:46.914008 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35205d54-a9f5-409f-af5e-810a6bdd2b2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:46.915396 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35205d54-a9f5-409f-af5e-810a6bdd2b2d None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:46.934368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-35205d54-a9f5-409f-af5e-810a6bdd2b2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:46.934368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:46.934368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:46.934368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:46.934368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:46.934368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:46.934368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:46.934368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:46.934368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:46.934368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:46.934368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:46.934368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:46.934368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:41:46.934368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:41:46.934368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:41:46.935420 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:41:46.935420 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:46.935420 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:46.935420 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:46.935420 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:46.935420 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:46.935420 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:46.935420 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:46.935420 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:41:46.935420 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:46.935420 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:46.935420 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:46.935420 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:46.935420 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:46.935420 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:46.935420 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:46.935420 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:46.936500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:41:46.936500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:41:46.936500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:46.936500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:41:46.936500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 445/863] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:41:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:46.941564 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70112bb-58fd-4c9f-8dbd-4ba06c3140a9 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:47.037100 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:47.043621 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70112bb-58fd-4c9f-8dbd-4ba06c3140a9 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:47.078916 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60952d6-bf78-402c-9765-280b6717470d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:47.079586 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60952d6-bf78-402c-9765-280b6717470d None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:47.079877 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60952d6-bf78-402c-9765-280b6717470d None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:47.080149 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60952d6-bf78-402c-9765-280b6717470d None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:47.080888 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60952d6-bf78-402c-9765-280b6717470d None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:47.081193 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60952d6-bf78-402c-9765-280b6717470d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:47.082558 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60952d6-bf78-402c-9765-280b6717470d None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:47.094466 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 419/864] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:41:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:47.100122 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35205d54-a9f5-409f-af5e-810a6bdd2b2d None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:47.175130 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:47.199699 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35205d54-a9f5-409f-af5e-810a6bdd2b2d None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:47.234368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1de65-f3b4-4dc6-8c64-329fc8c855e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:47.235162 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1de65-f3b4-4dc6-8c64-329fc8c855e0 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:47.235441 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1de65-f3b4-4dc6-8c64-329fc8c855e0 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:47.235714 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c1de65-f3b4-4dc6-8c64-329fc8c855e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:47.242623 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1de65-f3b4-4dc6-8c64-329fc8c855e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:47.244137 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c1de65-f3b4-4dc6-8c64-329fc8c855e0 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:47.259408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-13c1de65-f3b4-4dc6-8c64-329fc8c855e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:41:47.259408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:47.259408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:47.259408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:47.259408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:47.259408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:47.259408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:47.259408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:47.259408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:47.259408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:47.259408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:47.259408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:47.259408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:41:47.259408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:41:47.259408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:41:47.260464 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:41:47.260464 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:47.260464 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:47.260464 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:47.260464 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:47.260464 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:47.260464 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:47.260464 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:47.260464 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:41:47.260464 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:47.260464 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:47.260464 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:47.260464 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:47.260464 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:47.260464 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:47.260464 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:47.260464 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:47.261412 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:41:47.261412 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:41:47.261412 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:41:47.261412 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:41:47.261412 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:41:47.261412 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:41:47.261412 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:41:47.261412 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:41:47.261412 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 446/865] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:41:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:47.266916 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60952d6-bf78-402c-9765-280b6717470d None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:47.367917 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60952d6-bf78-402c-9765-280b6717470d None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:47.402830 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce13f94a-0001-48d6-8b4d-12f1c15b8107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:47.404195 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13f94a-0001-48d6-8b4d-12f1c15b8107 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:47.404195 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13f94a-0001-48d6-8b4d-12f1c15b8107 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:47.404195 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce13f94a-0001-48d6-8b4d-12f1c15b8107 None admin] PATH_INFO: `/v3/projects` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:47.404956 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13f94a-0001-48d6-8b4d-12f1c15b8107 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:47.405263 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13f94a-0001-48d6-8b4d-12f1c15b8107 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:47.406695 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce13f94a-0001-48d6-8b4d-12f1c15b8107 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:47.419270 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 420/866] 10.222.0.62 () {56 vars in 1148 bytes} [Wed May 25 15:41:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:47.429991 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1de65-f3b4-4dc6-8c64-329fc8c855e0 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:47.531432 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c1de65-f3b4-4dc6-8c64-329fc8c855e0 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:47.565376 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e1fd60-bb60-40a6-8cff-3e95d1c48436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:47.566026 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1fd60-bb60-40a6-8cff-3e95d1c48436 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:47.566308 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1fd60-bb60-40a6-8cff-3e95d1c48436 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:47.566579 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e1fd60-bb60-40a6-8cff-3e95d1c48436 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:47.567402 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1fd60-bb60-40a6-8cff-3e95d1c48436 None admin] RBAC: Adding query filter params (role.id=d1d28f6c8cb34e9f8af7cda9d128a351, scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5, user.id=2506613903044131b9e8c75196de862b) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:47.567709 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1fd60-bb60-40a6-8cff-3e95d1c48436 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:47.569161 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e1fd60-bb60-40a6-8cff-3e95d1c48436 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:47.571575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:47.575880 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 447/867] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:41:47 2022] GET /identity/v3/role_assignments?user.id=2506613903044131b9e8c75196de862b&scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5&role.id=d1d28f6c8cb34e9f8af7cda9d128a351 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:49.923255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8192d0-4f49-4130-a678-bc4d75e7298c None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:49.923827 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8192d0-4f49-4130-a678-bc4d75e7298c None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:49.923827 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8192d0-4f49-4130-a678-bc4d75e7298c None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:49.925212 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 421/868] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:41:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:41:49.931265 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cf399-a362-4dc8-b1b3-8733e2a685d3 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:49.931687 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cf399-a362-4dc8-b1b3-8733e2a685d3 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:49.931815 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2cf399-a362-4dc8-b1b3-8733e2a685d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:49.948971 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-2d2cf399-a362-4dc8-b1b3-8733e2a685d3 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:49.950160 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-2d2cf399-a362-4dc8-b1b3-8733e2a685d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:50.021703 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 448/869] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:41:49 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:41:50.048186 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8192d0-4f49-4130-a678-bc4d75e7298c None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:50.066776 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:50.150206 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8192d0-4f49-4130-a678-bc4d75e7298c None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:50.185338 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d30239-7f15-4d0d-b8ba-f00257a5cd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:50.186058 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d30239-7f15-4d0d-b8ba-f00257a5cd1d None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:50.186473 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d30239-7f15-4d0d-b8ba-f00257a5cd1d None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:50.186795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d30239-7f15-4d0d-b8ba-f00257a5cd1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:50.196855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d30239-7f15-4d0d-b8ba-f00257a5cd1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:41:50.204625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-70d30239-7f15-4d0d-b8ba-f00257a5cd1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:41:50.204625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:50.204625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:50.204625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:50.204625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:50.204625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:50.204625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:50.204625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:50.204625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:50.204625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:50.204625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:50.204625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:50.204625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:41:50.204625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:41:50.204625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:41:50.204625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:41:50.205752 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:41:50.205752 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:41:50.205752 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:41:50.205752 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:41:50.205752 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:50.205752 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:50.205752 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:50.205752 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:50.205752 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:50.205752 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:50.205752 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:50.205752 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:41:50.205752 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:50.205752 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:50.205752 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:50.205752 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:50.206984 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:50.206984 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:50.206984 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:50.206984 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:50.206984 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:41:50.206984 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:41:50.206984 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:41:50.206984 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:41:50.206984 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:41:50.206984 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:41:50.206984 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:41:50.206984 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:41:50.206984 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 422/870] 10.222.0.62 () {56 vars in 1096 bytes} [Wed May 25 15:41:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:50.211950 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cf399-a362-4dc8-b1b3-8733e2a685d3 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:50.314300 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2cf399-a362-4dc8-b1b3-8733e2a685d3 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:50.341322 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:50.348813 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a0bc1-dda3-47c3-a66a-f5bc3c77c59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:50.349481 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a0bc1-dda3-47c3-a66a-f5bc3c77c59a None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:50.349765 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a0bc1-dda3-47c3-a66a-f5bc3c77c59a None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:50.350037 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53a0bc1-dda3-47c3-a66a-f5bc3c77c59a None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:50.350877 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a0bc1-dda3-47c3-a66a-f5bc3c77c59a None admin] RBAC: Adding query filter params (name=admin) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:50.351256 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a0bc1-dda3-47c3-a66a-f5bc3c77c59a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:50.352664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53a0bc1-dda3-47c3-a66a-f5bc3c77c59a None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:50.360463 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 449/871] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:41:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:50.366118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d30239-7f15-4d0d-b8ba-f00257a5cd1d None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:50.447757 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:50.470013 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d30239-7f15-4d0d-b8ba-f00257a5cd1d None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:50.504889 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d96682-135d-45f7-b8dd-f1316e04d4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:50.505685 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d96682-135d-45f7-b8dd-f1316e04d4da None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:50.505971 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d96682-135d-45f7-b8dd-f1316e04d4da None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:50.506250 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d96682-135d-45f7-b8dd-f1316e04d4da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:50.517597 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d96682-135d-45f7-b8dd-f1316e04d4da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:50.519076 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d96682-135d-45f7-b8dd-f1316e04d4da None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:50.536574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-e0d96682-135d-45f7-b8dd-f1316e04d4da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:50.536574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:50.536574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:50.536574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:50.536574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:50.536574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:50.536574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:50.536574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:50.536574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:50.536574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:50.536574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:50.536574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:50.536574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:41:50.536574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:41:50.536574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:41:50.538441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:41:50.538441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:50.538441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:50.538441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:50.538441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:50.538441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:50.538441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:50.538441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:50.538441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:41:50.538441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:50.538441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:50.538441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:50.538441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:50.538441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:50.538441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:50.538441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:50.538441 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:50.539630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:41:50.539630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:41:50.539630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:50.539630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:41:50.539630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 423/872] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:41:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:50.544494 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a0bc1-dda3-47c3-a66a-f5bc3c77c59a None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:50.645906 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53a0bc1-dda3-47c3-a66a-f5bc3c77c59a None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:50.679545 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f92c8c-df11-4d6d-ae05-5a0e430d98aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:50.680204 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f92c8c-df11-4d6d-ae05-5a0e430d98aa None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:50.680544 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f92c8c-df11-4d6d-ae05-5a0e430d98aa None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:50.680807 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f92c8c-df11-4d6d-ae05-5a0e430d98aa None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:50.681518 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f92c8c-df11-4d6d-ae05-5a0e430d98aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:50.681827 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f92c8c-df11-4d6d-ae05-5a0e430d98aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:50.683227 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f92c8c-df11-4d6d-ae05-5a0e430d98aa None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:50.695986 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 450/873] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:41:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:50.703586 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d96682-135d-45f7-b8dd-f1316e04d4da None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:50.810144 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d96682-135d-45f7-b8dd-f1316e04d4da None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:50.835871 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:50.843518 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d46be-1acd-4891-ac17-c295ec3ebd4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:50.844346 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d46be-1acd-4891-ac17-c295ec3ebd4a None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:50.844656 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d46be-1acd-4891-ac17-c295ec3ebd4a None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:50.844931 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81d46be-1acd-4891-ac17-c295ec3ebd4a None admin] PATH_INFO: `/v3/users/placement` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:50.852804 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d46be-1acd-4891-ac17-c295ec3ebd4a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:50.854249 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81d46be-1acd-4891-ac17-c295ec3ebd4a None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:50.868670 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-e81d46be-1acd-4891-ac17-c295ec3ebd4a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 15:41:50.868670 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:50.868670 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:50.868670 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:50.868670 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:50.868670 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:50.868670 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:50.868670 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:50.868670 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:50.868670 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:50.868670 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:50.868670 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:50.868670 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:41:50.868670 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:41:50.868670 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:41:50.868670 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:41:50.869774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:50.869774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:50.869774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:41:50.869774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:41:50.869774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:41:50.869774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:41:50.869774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:50.869774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:50.869774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:50.869774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:50.869774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:50.869774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:41:50.869774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:50.869774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:50.869774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:50.869774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:50.869774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:50.869774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:50.871089 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:50.871089 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:50.871089 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:41:50.871089 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:41:50.871089 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:41:50.871089 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:41:50.871089 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:41:50.871089 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:41:50.871089 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 15:41:50.871089 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:41:50.871089 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 424/874] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:41:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:50.875725 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f92c8c-df11-4d6d-ae05-5a0e430d98aa None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:50.932325 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:50.981083 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f92c8c-df11-4d6d-ae05-5a0e430d98aa None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:51.015637 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662ac92-58c3-4b79-9540-4cda0b23e533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:51.016583 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662ac92-58c3-4b79-9540-4cda0b23e533 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:51.016866 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662ac92-58c3-4b79-9540-4cda0b23e533 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:51.017137 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8662ac92-58c3-4b79-9540-4cda0b23e533 None admin] PATH_INFO: `/v3/users` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:51.017958 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662ac92-58c3-4b79-9540-4cda0b23e533 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:51.018261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662ac92-58c3-4b79-9540-4cda0b23e533 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:51.019687 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8662ac92-58c3-4b79-9540-4cda0b23e533 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:51.036406 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 451/875] 10.222.0.62 () {56 vars in 1143 bytes} [Wed May 25 15:41:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:51.042897 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d46be-1acd-4891-ac17-c295ec3ebd4a None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:51.145749 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81d46be-1acd-4891-ac17-c295ec3ebd4a None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:51.182354 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e0688-1f8d-452f-a734-bfc2d5b9a139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:51.183003 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e0688-1f8d-452f-a734-bfc2d5b9a139 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:51.183287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e0688-1f8d-452f-a734-bfc2d5b9a139 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:51.183638 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331e0688-1f8d-452f-a734-bfc2d5b9a139 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:51.239030 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:51.252555 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e0688-1f8d-452f-a734-bfc2d5b9a139 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:51.254294 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331e0688-1f8d-452f-a734-bfc2d5b9a139 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:51.354378 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 425/876] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:41:51 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:41:51.360437 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662ac92-58c3-4b79-9540-4cda0b23e533 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:51.467052 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8662ac92-58c3-4b79-9540-4cda0b23e533 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:51.476831 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:51.501780 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e223f52-6e9e-42a7-bab5-1281d482b9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:51.502523 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e223f52-6e9e-42a7-bab5-1281d482b9db None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:51.502963 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e223f52-6e9e-42a7-bab5-1281d482b9db None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:51.503234 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e223f52-6e9e-42a7-bab5-1281d482b9db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:51.514452 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e223f52-6e9e-42a7-bab5-1281d482b9db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:51.516160 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e223f52-6e9e-42a7-bab5-1281d482b9db None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:51.534299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-5e223f52-6e9e-42a7-bab5-1281d482b9db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:51.534299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:51.534299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:51.534299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:51.534299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:51.534299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:51.534299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:51.534299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:51.534299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:51.534299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:51.534299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:51.534299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:51.534299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:41:51.534299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:41:51.534299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:41:51.535826 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:41:51.535826 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:51.535826 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:51.535826 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:51.535826 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:51.535826 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:51.535826 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:51.535826 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:51.535826 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:41:51.535826 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:51.535826 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:51.535826 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:51.535826 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:51.535826 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:51.535826 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:51.535826 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:51.535826 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:51.536904 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:41:51.536904 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:41:51.536904 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:51.536904 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:41:51.536904 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 452/877] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:41:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:51.541516 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e0688-1f8d-452f-a734-bfc2d5b9a139 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:51.634124 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:51.646211 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331e0688-1f8d-452f-a734-bfc2d5b9a139 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:51.681573 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146183d-0121-4575-b803-954024a7050b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:51.683009 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146183d-0121-4575-b803-954024a7050b None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:51.683480 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146183d-0121-4575-b803-954024a7050b None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:51.683843 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2146183d-0121-4575-b803-954024a7050b None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:51.684593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146183d-0121-4575-b803-954024a7050b None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:51.684906 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146183d-0121-4575-b803-954024a7050b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:51.686401 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2146183d-0121-4575-b803-954024a7050b None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:51.697990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 426/878] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:41:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:51.703721 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e223f52-6e9e-42a7-bab5-1281d482b9db None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:51.805582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e223f52-6e9e-42a7-bab5-1281d482b9db None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:51.840600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a6e7b-75aa-4778-a464-44f8f82c02f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:51.841393 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a6e7b-75aa-4778-a464-44f8f82c02f7 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:51.841678 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a6e7b-75aa-4778-a464-44f8f82c02f7 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:51.841952 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a6e7b-75aa-4778-a464-44f8f82c02f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:51.848624 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a6e7b-75aa-4778-a464-44f8f82c02f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:51.850090 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12a6e7b-75aa-4778-a464-44f8f82c02f7 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:51.864253 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-e12a6e7b-75aa-4778-a464-44f8f82c02f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:41:51.864253 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:51.864253 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:51.864253 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:51.864253 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:51.864253 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:51.864253 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:51.864253 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:51.864253 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:51.864253 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:51.864253 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:51.864253 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:51.864253 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:41:51.864253 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:41:51.864253 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:41:51.865364 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:41:51.865364 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:51.865364 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:51.865364 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:51.865364 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:51.865364 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:51.865364 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:51.865364 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:51.865364 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:41:51.865364 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:51.865364 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:51.865364 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:51.865364 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:51.865364 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:51.865364 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:51.865364 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:51.865364 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:51.867208 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:41:51.867208 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:41:51.867208 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:41:51.867208 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:41:51.867208 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:41:51.867208 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:41:51.867208 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:41:51.867208 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:41:51.867208 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 453/879] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:41:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:51.871893 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146183d-0121-4575-b803-954024a7050b None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:51.971709 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2146183d-0121-4575-b803-954024a7050b None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:52.006748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d62cca8-b67d-498b-bcd9-9e26b4d21ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:52.008002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62cca8-b67d-498b-bcd9-9e26b4d21ba9 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:52.008293 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62cca8-b67d-498b-bcd9-9e26b4d21ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:52.008609 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d62cca8-b67d-498b-bcd9-9e26b4d21ba9 None admin] PATH_INFO: `/v3/projects` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:52.009415 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62cca8-b67d-498b-bcd9-9e26b4d21ba9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:52.009751 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62cca8-b67d-498b-bcd9-9e26b4d21ba9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:52.011185 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d62cca8-b67d-498b-bcd9-9e26b4d21ba9 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:52.025044 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 427/880] 10.222.0.62 () {56 vars in 1148 bytes} [Wed May 25 15:41:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:52.031080 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a6e7b-75aa-4778-a464-44f8f82c02f7 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:52.055364 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:52.135464 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a6e7b-75aa-4778-a464-44f8f82c02f7 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:52.169887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849f639-bd6b-4f48-bf7d-0e92ffe747d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:52.170541 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849f639-bd6b-4f48-bf7d-0e92ffe747d5 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:52.170827 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849f639-bd6b-4f48-bf7d-0e92ffe747d5 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:52.171103 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849f639-bd6b-4f48-bf7d-0e92ffe747d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:52.171927 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849f639-bd6b-4f48-bf7d-0e92ffe747d5 None admin] RBAC: Adding query filter params (role.id=ae72bfdddd1e4a94a21a0d53264ee157, scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5, user.id=2506613903044131b9e8c75196de862b) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:52.172236 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849f639-bd6b-4f48-bf7d-0e92ffe747d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:52.173691 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849f639-bd6b-4f48-bf7d-0e92ffe747d5 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:52.179166 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 454/881] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:41:52 2022] GET /identity/v3/role_assignments?user.id=2506613903044131b9e8c75196de862b&scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5&role.id=ae72bfdddd1e4a94a21a0d53264ee157 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:54.445628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7fd22-8be9-4075-a63c-cf7100f8e98e None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:54.446145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7fd22-8be9-4075-a63c-cf7100f8e98e None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:54.446145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e7fd22-8be9-4075-a63c-cf7100f8e98e None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:54.447494 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 428/882] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:41:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:41:54.452843 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc473467-8ed4-4e1d-bc3d-74a7491cf4c4 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:54.453268 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc473467-8ed4-4e1d-bc3d-74a7491cf4c4 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:54.453457 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc473467-8ed4-4e1d-bc3d-74a7491cf4c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:54.470414 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-cc473467-8ed4-4e1d-bc3d-74a7491cf4c4 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:54.471678 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-cc473467-8ed4-4e1d-bc3d-74a7491cf4c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:54.539173 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 455/883] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:41:54 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:41:54.563493 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7fd22-8be9-4075-a63c-cf7100f8e98e None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:54.574967 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:54.667047 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e7fd22-8be9-4075-a63c-cf7100f8e98e None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:54.701542 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0e858-4a7e-4342-b4a8-cb28e51f3e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:54.702265 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0e858-4a7e-4342-b4a8-cb28e51f3e0c None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:54.702550 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0e858-4a7e-4342-b4a8-cb28e51f3e0c None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:54.702827 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a0e858-4a7e-4342-b4a8-cb28e51f3e0c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:54.712941 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a0e858-4a7e-4342-b4a8-cb28e51f3e0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:41:54.723593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-89a0e858-4a7e-4342-b4a8-cb28e51f3e0c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:41:54.723593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:54.723593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:54.723593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:54.723593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:54.723593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:54.723593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:54.723593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:54.723593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:54.723593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:54.723593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:54.723593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:54.723593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:41:54.723593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:41:54.723593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:41:54.723593 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:41:54.725310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:41:54.725310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:41:54.725310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:41:54.725310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:41:54.725310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:54.725310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:54.725310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:54.725310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:54.725310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:54.725310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:54.725310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:54.725310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:41:54.725310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:54.725310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:54.725310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:54.725310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:54.727678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:54.727678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:54.727678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:54.727678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:54.727678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:41:54.727678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:41:54.727678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:41:54.727678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:41:54.727678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:41:54.727678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:41:54.727678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:41:54.727678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:41:54.727678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 429/884] 10.222.0.62 () {56 vars in 1096 bytes} [Wed May 25 15:41:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:54.733170 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc473467-8ed4-4e1d-bc3d-74a7491cf4c4 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:54.748899 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:54.835585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc473467-8ed4-4e1d-bc3d-74a7491cf4c4 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:54.870756 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3de694-d626-4ca9-b3ca-4b469c328907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:54.871427 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3de694-d626-4ca9-b3ca-4b469c328907 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:54.871719 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3de694-d626-4ca9-b3ca-4b469c328907 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:54.872059 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3de694-d626-4ca9-b3ca-4b469c328907 None admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:54.872837 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3de694-d626-4ca9-b3ca-4b469c328907 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:54.873144 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3de694-d626-4ca9-b3ca-4b469c328907 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:54.874518 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3de694-d626-4ca9-b3ca-4b469c328907 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:54.882653 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 456/885] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:41:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:54.889922 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0e858-4a7e-4342-b4a8-cb28e51f3e0c None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:54.956119 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:54.990029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a0e858-4a7e-4342-b4a8-cb28e51f3e0c None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:55.025809 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992fdfe-82e5-457d-b442-e9fc69e3a567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:55.026596 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992fdfe-82e5-457d-b442-e9fc69e3a567 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:55.026902 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992fdfe-82e5-457d-b442-e9fc69e3a567 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:55.027177 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b992fdfe-82e5-457d-b442-e9fc69e3a567 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:55.037781 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992fdfe-82e5-457d-b442-e9fc69e3a567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:55.039299 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b992fdfe-82e5-457d-b442-e9fc69e3a567 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:55.057989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-b992fdfe-82e5-457d-b442-e9fc69e3a567 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:55.057989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:55.057989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:55.057989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:55.057989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:55.057989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:55.057989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:55.057989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:55.057989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:55.057989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:55.057989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:55.057989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:55.057989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:41:55.057989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:41:55.057989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:41:55.059137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:41:55.059137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:55.059137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:55.059137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:55.059137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:55.059137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:55.059137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:55.059137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:55.059137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:41:55.059137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:55.059137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:55.059137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:55.059137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:55.059137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:55.059137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:55.059137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:55.059137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:55.060122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:41:55.060122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:41:55.060122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:55.060122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:41:55.060122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 430/886] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:41:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:55.065000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3de694-d626-4ca9-b3ca-4b469c328907 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:55.147476 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:55.169972 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3de694-d626-4ca9-b3ca-4b469c328907 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:55.205307 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d4792-abbb-45e7-8302-b1473d78734e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:55.205972 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d4792-abbb-45e7-8302-b1473d78734e None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:55.206302 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d4792-abbb-45e7-8302-b1473d78734e None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:55.206531 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56d4792-abbb-45e7-8302-b1473d78734e None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:55.207246 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d4792-abbb-45e7-8302-b1473d78734e None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:55.207555 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d4792-abbb-45e7-8302-b1473d78734e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:55.209088 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56d4792-abbb-45e7-8302-b1473d78734e None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:55.220798 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 457/887] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:55.226952 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992fdfe-82e5-457d-b442-e9fc69e3a567 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:55.329677 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b992fdfe-82e5-457d-b442-e9fc69e3a567 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:55.349418 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:55.363874 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5c014-ec17-402d-b0e7-f8d58ae9aeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:55.364702 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5c014-ec17-402d-b0e7-f8d58ae9aeef None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:55.364986 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5c014-ec17-402d-b0e7-f8d58ae9aeef None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:55.365259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5c014-ec17-402d-b0e7-f8d58ae9aeef None admin] PATH_INFO: `/v3/users/placement` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:55.373744 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5c014-ec17-402d-b0e7-f8d58ae9aeef None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:55.375173 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5c014-ec17-402d-b0e7-f8d58ae9aeef None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:55.389259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-65b5c014-ec17-402d-b0e7-f8d58ae9aeef None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 15:41:55.389259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:55.389259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:55.389259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:55.389259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:55.389259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:55.389259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:55.389259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:55.389259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:55.389259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:55.389259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:55.389259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:55.389259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:41:55.389259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:41:55.389259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:41:55.389259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:41:55.390367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:55.390367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:55.390367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:41:55.390367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:41:55.390367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:41:55.390367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:41:55.390367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:55.390367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:55.390367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:55.390367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:55.390367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:55.390367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:41:55.390367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:55.390367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:55.390367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:55.390367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:55.390367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:55.390367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:55.391995 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:55.391995 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:55.391995 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:41:55.391995 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:41:55.391995 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:41:55.391995 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:41:55.391995 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:41:55.391995 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:41:55.391995 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 15:41:55.391995 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:41:55.391995 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 431/888] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:41:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:41:55.398259 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d4792-abbb-45e7-8302-b1473d78734e None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:55.500748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56d4792-abbb-45e7-8302-b1473d78734e None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:55.533747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751192d-3e61-46f2-bd0d-ad6c82ae59ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:55.534410 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751192d-3e61-46f2-bd0d-ad6c82ae59ad None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:55.534746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751192d-3e61-46f2-bd0d-ad6c82ae59ad None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:55.535040 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1751192d-3e61-46f2-bd0d-ad6c82ae59ad None admin] PATH_INFO: `/v3/users` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:55.535856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751192d-3e61-46f2-bd0d-ad6c82ae59ad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:55.536160 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751192d-3e61-46f2-bd0d-ad6c82ae59ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:55.537623 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1751192d-3e61-46f2-bd0d-ad6c82ae59ad None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:55.540775 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:55.555778 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 458/889] 10.222.0.62 () {56 vars in 1143 bytes} [Wed May 25 15:41:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:55.561623 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5c014-ec17-402d-b0e7-f8d58ae9aeef None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:55.660726 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5c014-ec17-402d-b0e7-f8d58ae9aeef None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:55.695091 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e5768-263d-4670-832d-abc865f5e771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:55.701414 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e5768-263d-4670-832d-abc865f5e771 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:55.701414 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e5768-263d-4670-832d-abc865f5e771 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:55.701414 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e5768-263d-4670-832d-abc865f5e771 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:55.706768 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e5768-263d-4670-832d-abc865f5e771 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:55.708251 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e5768-263d-4670-832d-abc865f5e771 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:55.725662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-d43e5768-263d-4670-832d-abc865f5e771 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:55.725662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:55.725662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:55.725662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:55.725662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:55.725662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:55.725662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:55.725662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:55.725662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:55.725662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:55.725662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:55.725662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:55.725662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:41:55.725662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:41:55.725662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:41:55.726770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:41:55.726770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:55.726770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:55.726770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:55.726770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:55.726770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:55.726770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:55.726770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:55.726770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:41:55.726770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:55.726770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:55.726770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:55.726770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:55.726770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:55.726770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:55.726770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:55.726770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:55.733188 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:41:55.733188 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:41:55.733188 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:55.733188 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:41:55.733188 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 432/890] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:41:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:55.733537 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751192d-3e61-46f2-bd0d-ad6c82ae59ad None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:55.835926 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1751192d-3e61-46f2-bd0d-ad6c82ae59ad None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:55.873951 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b942faa-875f-46d0-b562-dae7396ee754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:55.874621 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b942faa-875f-46d0-b562-dae7396ee754 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:55.874901 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b942faa-875f-46d0-b562-dae7396ee754 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:55.875174 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b942faa-875f-46d0-b562-dae7396ee754 None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:55.875890 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b942faa-875f-46d0-b562-dae7396ee754 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:55.876198 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b942faa-875f-46d0-b562-dae7396ee754 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:55.877629 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b942faa-875f-46d0-b562-dae7396ee754 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:55.889239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 459/891] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:41:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:55.895286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e5768-263d-4670-832d-abc865f5e771 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:55.928469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:55.995049 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e5768-263d-4670-832d-abc865f5e771 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:56.029700 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34361508-106d-4add-b0b9-80ba636269a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:56.030556 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34361508-106d-4add-b0b9-80ba636269a4 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:56.030840 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34361508-106d-4add-b0b9-80ba636269a4 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:56.031114 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34361508-106d-4add-b0b9-80ba636269a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:56.038511 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34361508-106d-4add-b0b9-80ba636269a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:56.039944 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34361508-106d-4add-b0b9-80ba636269a4 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:56.053648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-34361508-106d-4add-b0b9-80ba636269a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:41:56.053648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:56.053648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:56.053648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:56.053648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:56.053648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:56.053648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:56.053648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:56.053648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:56.053648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:56.053648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:56.053648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:56.053648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:41:56.053648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:41:56.053648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:41:56.054903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:41:56.054903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:56.054903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:56.054903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:56.054903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:56.054903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:56.054903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:56.054903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:56.054903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:41:56.054903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:56.054903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:56.054903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:56.054903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:56.054903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:56.054903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:56.054903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:56.054903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:56.055967 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:41:56.055967 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:41:56.055967 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:41:56.055967 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:41:56.055967 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:41:56.055967 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:41:56.055967 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:41:56.055967 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:41:56.055967 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 433/892] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:41:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:56.060678 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b942faa-875f-46d0-b562-dae7396ee754 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:56.118539 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:56.165021 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b942faa-875f-46d0-b562-dae7396ee754 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:56.199681 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97edcd-f6ca-4c58-80ff-ee3e377ec65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:56.200439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97edcd-f6ca-4c58-80ff-ee3e377ec65f None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:56.200773 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97edcd-f6ca-4c58-80ff-ee3e377ec65f None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:56.201144 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97edcd-f6ca-4c58-80ff-ee3e377ec65f None admin] PATH_INFO: `/v3/projects` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:56.201975 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97edcd-f6ca-4c58-80ff-ee3e377ec65f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:56.202330 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97edcd-f6ca-4c58-80ff-ee3e377ec65f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:56.203944 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe97edcd-f6ca-4c58-80ff-ee3e377ec65f None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:56.217791 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 460/893] 10.222.0.62 () {56 vars in 1148 bytes} [Wed May 25 15:41:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:56.223924 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34361508-106d-4add-b0b9-80ba636269a4 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:56.315633 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:56.324822 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34361508-106d-4add-b0b9-80ba636269a4 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:56.357900 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f8e236-ea74-4575-91c9-68590000ae36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:56.358772 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8e236-ea74-4575-91c9-68590000ae36 None admin] REQUEST_METHOD: `PUT` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:56.359055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8e236-ea74-4575-91c9-68590000ae36 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:56.359328 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8e236-ea74-4575-91c9-68590000ae36 None admin] PATH_INFO: `/v3/projects/5e951a6f0d6947dfae3ac132afbcd4b5/users/2506613903044131b9e8c75196de862b/roles/ae72bfdddd1e4a94a21a0d53264ee157` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:56.361297 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8e236-ea74-4575-91c9-68590000ae36 None admin] RBAC: Authorizing `identity:create_grant(project_id=5e951a6f0d6947dfae3ac132afbcd4b5, user_id=2506613903044131b9e8c75196de862b, role_id=ae72bfdddd1e4a94a21a0d53264ee157)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:56.362817 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f8e236-ea74-4575-91c9-68590000ae36 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:56.542277 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 434/894] 10.222.0.62 () {58 vars in 1439 bytes} [Wed May 25 15:41:56 2022] PUT /identity/v3/projects/5e951a6f0d6947dfae3ac132afbcd4b5/users/2506613903044131b9e8c75196de862b/roles/ae72bfdddd1e4a94a21a0d53264ee157 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:41:58.831405 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3de020-a6d7-432f-a95e-448ec35db811 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:58.831984 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3de020-a6d7-432f-a95e-448ec35db811 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:58.831984 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3de020-a6d7-432f-a95e-448ec35db811 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:58.833527 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 461/895] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:41:58.839501 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c3269-30a6-4dbf-92ca-ae1332a7b935 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:58.841408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c3269-30a6-4dbf-92ca-ae1332a7b935 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:58.841408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189c3269-30a6-4dbf-92ca-ae1332a7b935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:58.857393 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-189c3269-30a6-4dbf-92ca-ae1332a7b935 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:41:58.858629 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-189c3269-30a6-4dbf-92ca-ae1332a7b935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:41:58.926088 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 435/896] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:41:58 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:41:58.952778 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3de020-a6d7-432f-a95e-448ec35db811 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:59.054276 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3de020-a6d7-432f-a95e-448ec35db811 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:59.067605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:59.087904 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce80c7-f3aa-4ba0-b70e-f4df67ee0d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:59.088680 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce80c7-f3aa-4ba0-b70e-f4df67ee0d46 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:59.088964 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce80c7-f3aa-4ba0-b70e-f4df67ee0d46 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:59.089267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce80c7-f3aa-4ba0-b70e-f4df67ee0d46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:59.099268 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce80c7-f3aa-4ba0-b70e-f4df67ee0d46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 15:41:59.107036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-4bce80c7-f3aa-4ba0-b70e-f4df67ee0d46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:41:59.107036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:59.107036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:59.107036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:59.107036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:59.107036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:59.107036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:59.107036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:59.107036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:59.107036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:59.107036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:59.107036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:59.107036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 15:41:59.107036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 15:41:59.107036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 15:41:59.107036 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 15:41:59.107961 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 15:41:59.107961 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 15:41:59.107961 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 15:41:59.107961 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 15:41:59.107961 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:59.107961 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:59.107961 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:59.107961 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:59.107961 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:59.107961 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:59.107961 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:59.107961 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:41:59.107961 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:59.107961 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:59.107961 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:59.107961 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:59.108876 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:59.108876 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:59.108876 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:59.108876 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:59.108876 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 15:41:59.108876 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 15:41:59.108876 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 15:41:59.108876 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 15:41:59.108876 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 15:41:59.108876 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 15:41:59.108876 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 15:41:59.108876 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:41:59.108876 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 462/897] 10.222.0.62 () {56 vars in 1096 bytes} [Wed May 25 15:41:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:59.114473 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c3269-30a6-4dbf-92ca-ae1332a7b935 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:59.202162 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:59.219993 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189c3269-30a6-4dbf-92ca-ae1332a7b935 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:59.253198 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458ef1f-4885-4a2d-a27d-5a2c5dc3aed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:59.253862 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458ef1f-4885-4a2d-a27d-5a2c5dc3aed7 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:59.254149 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458ef1f-4885-4a2d-a27d-5a2c5dc3aed7 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:59.254429 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1458ef1f-4885-4a2d-a27d-5a2c5dc3aed7 None admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:59.255178 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458ef1f-4885-4a2d-a27d-5a2c5dc3aed7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:59.255498 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458ef1f-4885-4a2d-a27d-5a2c5dc3aed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:59.257763 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1458ef1f-4885-4a2d-a27d-5a2c5dc3aed7 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:59.265964 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 436/898] 10.222.0.62 () {56 vars in 1099 bytes} [Wed May 25 15:41:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:59.271682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce80c7-f3aa-4ba0-b70e-f4df67ee0d46 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:59.376122 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce80c7-f3aa-4ba0-b70e-f4df67ee0d46 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:59.411063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08374db-040e-4fa4-9d98-4d2de502df26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:59.411650 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08374db-040e-4fa4-9d98-4d2de502df26 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:59.411938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08374db-040e-4fa4-9d98-4d2de502df26 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:59.412211 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08374db-040e-4fa4-9d98-4d2de502df26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:59.423292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08374db-040e-4fa4-9d98-4d2de502df26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:59.424771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08374db-040e-4fa4-9d98-4d2de502df26 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:59.442467 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-a08374db-040e-4fa4-9d98-4d2de502df26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:59.442467 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:59.442467 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:59.442467 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:59.442467 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:59.442467 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:59.442467 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:59.442467 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:59.442467 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:59.442467 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:59.442467 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:59.442467 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:59.442467 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:41:59.442467 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:41:59.442467 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:41:59.443619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:41:59.443619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:59.443619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:59.443619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:59.443619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:59.443619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:59.443619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:59.443619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:59.443619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:41:59.443619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:59.443619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:59.443619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:59.443619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:59.443619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:59.443619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:59.443619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:59.443619 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:59.445941 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:41:59.445941 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:41:59.445941 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:41:59.445941 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:41:59.445941 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 463/899] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:41:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:59.450662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458ef1f-4885-4a2d-a27d-5a2c5dc3aed7 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:59.550132 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1458ef1f-4885-4a2d-a27d-5a2c5dc3aed7 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:59.584668 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b3b99-7c9b-4b30-b2b1-76e92c45295a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:59.585504 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b3b99-7c9b-4b30-b2b1-76e92c45295a None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:59.585789 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b3b99-7c9b-4b30-b2b1-76e92c45295a None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:59.586075 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61b3b99-7c9b-4b30-b2b1-76e92c45295a None admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:59.586825 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b3b99-7c9b-4b30-b2b1-76e92c45295a None admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:59.587137 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b3b99-7c9b-4b30-b2b1-76e92c45295a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:59.588617 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61b3b99-7c9b-4b30-b2b1-76e92c45295a None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:59.601031 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 437/900] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:41:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:59.606989 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08374db-040e-4fa4-9d98-4d2de502df26 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:59.636181 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:59.709645 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08374db-040e-4fa4-9d98-4d2de502df26 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:59.743577 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f23ac-8089-4e3f-86bb-8288c4a70479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:59.744375 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f23ac-8089-4e3f-86bb-8288c4a70479 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:59.744683 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f23ac-8089-4e3f-86bb-8288c4a70479 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:59.744954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206f23ac-8089-4e3f-86bb-8288c4a70479 None admin] PATH_INFO: `/v3/users/placement` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:59.752283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f23ac-8089-4e3f-86bb-8288c4a70479 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:59.753855 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206f23ac-8089-4e3f-86bb-8288c4a70479 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:59.770604 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-206f23ac-8089-4e3f-86bb-8288c4a70479 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 15:41:59.770604 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:41:59.770604 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:41:59.770604 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:41:59.770604 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:41:59.770604 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:41:59.770604 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:41:59.770604 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:41:59.770604 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:41:59.770604 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:41:59.770604 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:41:59.770604 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:41:59.770604 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 15:41:59.770604 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 15:41:59.770604 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 15:41:59.770604 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 15:41:59.771712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:41:59.771712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:41:59.771712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 15:41:59.771712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:41:59.771712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 15:41:59.771712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 15:41:59.771712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:41:59.771712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:41:59.771712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:41:59.771712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:41:59.771712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:41:59.771712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:41:59.771712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:41:59.771712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:41:59.771712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:41:59.771712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:41:59.771712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:41:59.771712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:41:59.772939 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:41:59.772939 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:41:59.772939 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 15:41:59.772939 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 15:41:59.772939 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 15:41:59.772939 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 15:41:59.772939 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 15:41:59.772939 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 15:41:59.772939 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 15:41:59.772939 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:41:59.772939 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 464/901] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:41:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:41:59.777853 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b3b99-7c9b-4b30-b2b1-76e92c45295a None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:41:59.781715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:41:59.885833 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61b3b99-7c9b-4b30-b2b1-76e92c45295a None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:41:59.921204 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b9b90-6b19-49ab-a483-ebf343a3f2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:41:59.921862 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b9b90-6b19-49ab-a483-ebf343a3f2c9 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:41:59.922157 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b9b90-6b19-49ab-a483-ebf343a3f2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:41:59.922443 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584b9b90-6b19-49ab-a483-ebf343a3f2c9 None admin] PATH_INFO: `/v3/users` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:41:59.923276 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b9b90-6b19-49ab-a483-ebf343a3f2c9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:41:59.923594 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b9b90-6b19-49ab-a483-ebf343a3f2c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:41:59.925096 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584b9b90-6b19-49ab-a483-ebf343a3f2c9 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:41:59.943484 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 438/902] 10.222.0.62 () {56 vars in 1143 bytes} [Wed May 25 15:41:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:41:59.949541 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f23ac-8089-4e3f-86bb-8288c4a70479 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:00.035347 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:00.050815 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206f23ac-8089-4e3f-86bb-8288c4a70479 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:00.083892 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135ff18-cec8-448d-a47b-e1e253857aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:00.084596 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135ff18-cec8-448d-a47b-e1e253857aa1 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:00.084879 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135ff18-cec8-448d-a47b-e1e253857aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:00.085156 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135ff18-cec8-448d-a47b-e1e253857aa1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:00.153106 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135ff18-cec8-448d-a47b-e1e253857aa1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:00.154579 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5135ff18-cec8-448d-a47b-e1e253857aa1 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:00.239000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:00.254207 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 465/903] 10.222.0.62 () {58 vars in 1282 bytes} [Wed May 25 15:41:59 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 15:42:00.260311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b9b90-6b19-49ab-a483-ebf343a3f2c9 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:00.325320 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:00.367187 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584b9b90-6b19-49ab-a483-ebf343a3f2c9 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:00.403752 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9235cb-da2f-45db-98ee-d716b6b55c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:00.404577 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9235cb-da2f-45db-98ee-d716b6b55c2d None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:00.404866 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9235cb-da2f-45db-98ee-d716b6b55c2d None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:00.405144 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9235cb-da2f-45db-98ee-d716b6b55c2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:00.417683 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9235cb-da2f-45db-98ee-d716b6b55c2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:00.419152 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9235cb-da2f-45db-98ee-d716b6b55c2d None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:00.437890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-ff9235cb-da2f-45db-98ee-d716b6b55c2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:42:00.437890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:42:00.437890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:42:00.437890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:42:00.437890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:42:00.437890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:42:00.437890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:42:00.437890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:42:00.437890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:42:00.437890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:42:00.437890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:42:00.437890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:42:00.437890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 15:42:00.437890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 15:42:00.437890 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 15:42:00.439004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 15:42:00.439004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:42:00.439004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:42:00.439004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:42:00.439004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:42:00.439004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:42:00.439004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:42:00.439004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:42:00.439004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:42:00.439004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:42:00.439004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:42:00.439004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:42:00.439004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:42:00.439004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:42:00.439004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:42:00.439004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:42:00.439004 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:42:00.440084 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 15:42:00.440084 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 15:42:00.440084 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 15:42:00.440084 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:42:00.440084 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 439/904] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:42:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:42:00.445170 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135ff18-cec8-448d-a47b-e1e253857aa1 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:00.544695 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5135ff18-cec8-448d-a47b-e1e253857aa1 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:00.578670 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec4a83-6d19-4fb9-8f91-ea15753ce3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:00.579326 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec4a83-6d19-4fb9-8f91-ea15753ce3c7 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:00.579606 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec4a83-6d19-4fb9-8f91-ea15753ce3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:00.579877 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec4a83-6d19-4fb9-8f91-ea15753ce3c7 None admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:00.581399 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec4a83-6d19-4fb9-8f91-ea15753ce3c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:42:00.581399 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec4a83-6d19-4fb9-8f91-ea15753ce3c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:00.588449 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdec4a83-6d19-4fb9-8f91-ea15753ce3c7 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:00.594816 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 466/905] 10.222.0.62 () {56 vars in 1109 bytes} [Wed May 25 15:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:42:00.600705 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9235cb-da2f-45db-98ee-d716b6b55c2d None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:00.701765 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9235cb-da2f-45db-98ee-d716b6b55c2d None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:00.716047 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:00.735491 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b49770-21d8-4a60-8f34-19f7c078c4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:00.736282 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b49770-21d8-4a60-8f34-19f7c078c4c1 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:00.736598 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b49770-21d8-4a60-8f34-19f7c078c4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:00.736878 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b49770-21d8-4a60-8f34-19f7c078c4c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:00.743506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b49770-21d8-4a60-8f34-19f7c078c4c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:00.744973 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b49770-21d8-4a60-8f34-19f7c078c4c1 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:00.759786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application [None req-d0b49770-21d8-4a60-8f34-19f7c078c4c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:42:00.759786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:42:00.759786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:42:00.759786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:42:00.759786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:42:00.759786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:42:00.759786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:42:00.759786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:42:00.759786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:42:00.759786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:42:00.759786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:42:00.759786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:42:00.759786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 15:42:00.759786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 15:42:00.759786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 15:42:00.761696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 15:42:00.761696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:42:00.761696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:42:00.761696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:42:00.761696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:42:00.761696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:42:00.761696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:42:00.761696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:42:00.761696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application with Lock( May 25 15:42:00.761696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:42:00.761696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._enter() May 25 15:42:00.761696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:42:00.761696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:42:00.761696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:42:00.761696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.creator() May 25 15:42:00.761696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:42:00.761696 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application created_value = creator( May 25 15:42:00.763989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 15:42:00.763989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 15:42:00.763989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 15:42:00.763989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 15:42:00.763989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 15:42:00.763989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 15:42:00.763989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 15:42:00.763989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: ERROR keystone.server.flask.application May 25 15:42:00.763989 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 440/906] 10.222.0.62 () {56 vars in 1111 bytes} [Wed May 25 15:42:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 15:42:00.768827 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec4a83-6d19-4fb9-8f91-ea15753ce3c7 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:00.817099 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:00.869757 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdec4a83-6d19-4fb9-8f91-ea15753ce3c7 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:00.905630 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea015800-4aa4-4f99-bc93-32c83208b9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:00.906337 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea015800-4aa4-4f99-bc93-32c83208b9c4 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:00.906620 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea015800-4aa4-4f99-bc93-32c83208b9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:00.906898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea015800-4aa4-4f99-bc93-32c83208b9c4 None admin] PATH_INFO: `/v3/projects` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:00.907684 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea015800-4aa4-4f99-bc93-32c83208b9c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:42:00.907994 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea015800-4aa4-4f99-bc93-32c83208b9c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:00.909456 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea015800-4aa4-4f99-bc93-32c83208b9c4 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:00.921622 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 467/907] 10.222.0.62 () {56 vars in 1148 bytes} [Wed May 25 15:42:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:42:00.927709 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b49770-21d8-4a60-8f34-19f7c078c4c1 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:01.028995 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b49770-21d8-4a60-8f34-19f7c078c4c1 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:01.062836 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a81baf-ba86-4872-92f6-bc3fb1727491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:01.063497 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a81baf-ba86-4872-92f6-bc3fb1727491 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:01.063782 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a81baf-ba86-4872-92f6-bc3fb1727491 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:01.064060 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a81baf-ba86-4872-92f6-bc3fb1727491 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:01.064977 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a81baf-ba86-4872-92f6-bc3fb1727491 None admin] RBAC: Adding query filter params (role.id=ae72bfdddd1e4a94a21a0d53264ee157, scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5, user.id=2506613903044131b9e8c75196de862b) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:42:01.065296 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a81baf-ba86-4872-92f6-bc3fb1727491 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:01.066815 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a81baf-ba86-4872-92f6-bc3fb1727491 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:01.072824 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 441/908] 10.222.0.62 () {56 vars in 1374 bytes} [Wed May 25 15:42:00 2022] GET /identity/v3/role_assignments?user.id=2506613903044131b9e8c75196de862b&scope.project.id=5e951a6f0d6947dfae3ac132afbcd4b5&role.id=ae72bfdddd1e4a94a21a0d53264ee157 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:42:03.390688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78d5b5-e9da-4b49-b77b-5d9e0322c19a None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:03.391221 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78d5b5-e9da-4b49-b77b-5d9e0322c19a None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:03.391221 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78d5b5-e9da-4b49-b77b-5d9e0322c19a None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:03.392572 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 468/909] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:42:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:42:03.398529 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d955ffc-758a-4952-8e36-f7564767d609 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:03.399440 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d955ffc-758a-4952-8e36-f7564767d609 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:03.399440 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d955ffc-758a-4952-8e36-f7564767d609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:03.418325 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-2d955ffc-758a-4952-8e36-f7564767d609 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:42:03.419531 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-2d955ffc-758a-4952-8e36-f7564767d609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:42:03.450717 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:03.488877 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 442/910] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:42:03 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:42:03.512340 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78d5b5-e9da-4b49-b77b-5d9e0322c19a None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:03.614830 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78d5b5-e9da-4b49-b77b-5d9e0322c19a None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:03.622201 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:03.649596 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388672f-3091-48a5-b633-a2349dc2ffc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:03.650328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388672f-3091-48a5-b633-a2349dc2ffc0 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:03.650611 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388672f-3091-48a5-b633-a2349dc2ffc0 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:03.650974 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388672f-3091-48a5-b633-a2349dc2ffc0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:03.651603 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388672f-3091-48a5-b633-a2349dc2ffc0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:03.653016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388672f-3091-48a5-b633-a2349dc2ffc0 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:03.665138 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-a388672f-3091-48a5-b633-a2349dc2ffc0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:42:03.665138 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:42:03.665138 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:42:03.665138 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:42:03.665138 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:42:03.665138 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:42:03.665138 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:42:03.665138 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:42:03.665138 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:42:03.665138 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:42:03.665138 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:42:03.665138 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:42:03.665138 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:42:03.665138 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:42:03.665138 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:42:03.665138 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:42:03.665138 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:42:03.666559 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:42:03.666559 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:42:03.666559 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:42:03.666559 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:42:03.666559 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:42:03.666559 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:42:03.666559 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:42:03.666559 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:42:03.666559 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:42:03.666559 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:42:03.666559 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:42:03.666559 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:42:03.666559 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:42:03.666559 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:42:03.666559 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:42:03.666559 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:42:03.667654 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:42:03.667654 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:42:03.667654 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:42:03.667654 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:42:03.667654 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:42:03.667654 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:42:03.667654 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:42:03.667654 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:42:03.667654 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:42:03.667654 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:42:03.667654 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:42:03.667654 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:42:03.667654 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:42:03.667654 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:42:03.667654 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 469/911] 10.222.0.62 () {56 vars in 1117 bytes} [Wed May 25 15:42:03 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:42:03.673866 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d955ffc-758a-4952-8e36-f7564767d609 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:03.774495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d955ffc-758a-4952-8e36-f7564767d609 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:03.811029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f75e402-c9f3-4051-b618-f972477689e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:03.811692 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75e402-c9f3-4051-b618-f972477689e9 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:03.811975 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75e402-c9f3-4051-b618-f972477689e9 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:03.812250 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f75e402-c9f3-4051-b618-f972477689e9 None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:03.812985 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75e402-c9f3-4051-b618-f972477689e9 None admin] RBAC: Adding query filter params (name=placement) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:42:03.813291 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75e402-c9f3-4051-b618-f972477689e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:03.814757 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f75e402-c9f3-4051-b618-f972477689e9 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:03.819895 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 443/912] 10.222.0.62 () {56 vars in 1116 bytes} [Wed May 25 15:42:03 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:42:03.825897 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388672f-3091-48a5-b633-a2349dc2ffc0 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:03.927328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388672f-3091-48a5-b633-a2349dc2ffc0 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:03.961296 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3717e-0909-4feb-948c-f31482be98e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:03.961954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3717e-0909-4feb-948c-f31482be98e7 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:03.962238 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3717e-0909-4feb-948c-f31482be98e7 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:03.962513 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3717e-0909-4feb-948c-f31482be98e7 None admin] PATH_INFO: `/v3/services` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:03.963299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3717e-0909-4feb-948c-f31482be98e7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:42:03.963640 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3717e-0909-4feb-948c-f31482be98e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:03.965050 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3717e-0909-4feb-948c-f31482be98e7 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:03.969634 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 470/913] 10.222.0.62 () {56 vars in 1116 bytes} [Wed May 25 15:42:03 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:42:06.331631 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593e429-40c5-472c-a116-63a8e64e0dd7 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:06.332153 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593e429-40c5-472c-a116-63a8e64e0dd7 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:06.332581 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593e429-40c5-472c-a116-63a8e64e0dd7 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:06.335475 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 444/914] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:42:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:42:06.341596 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53702dc-b42f-41df-bf90-f5315d1899e0 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:06.342077 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53702dc-b42f-41df-bf90-f5315d1899e0 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:06.345272 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53702dc-b42f-41df-bf90-f5315d1899e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:06.360707 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-b53702dc-b42f-41df-bf90-f5315d1899e0 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:42:06.361916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-b53702dc-b42f-41df-bf90-f5315d1899e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:42:06.395589 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:06.439869 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 471/915] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:42:06 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:42:06.467786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593e429-40c5-472c-a116-63a8e64e0dd7 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:06.509039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:06.591725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593e429-40c5-472c-a116-63a8e64e0dd7 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:06.635637 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23b2b4-453e-4659-b759-a1976d265bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:06.636352 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23b2b4-453e-4659-b759-a1976d265bf2 None admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:06.636662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23b2b4-453e-4659-b759-a1976d265bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:06.636935 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23b2b4-453e-4659-b759-a1976d265bf2 None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:06.637664 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23b2b4-453e-4659-b759-a1976d265bf2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:06.639147 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23b2b4-453e-4659-b759-a1976d265bf2 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:06.749122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 445/916] 10.222.0.62 () {60 vars in 1141 bytes} [Wed May 25 15:42:06 2022] POST /identity/v3/services => generated 246 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:42:09.064407 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778fbf5-2ef6-4229-9173-9bb29183ca84 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:09.064988 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778fbf5-2ef6-4229-9173-9bb29183ca84 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:09.065096 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c778fbf5-2ef6-4229-9173-9bb29183ca84 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:09.066438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 472/917] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:42:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:42:09.072102 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbffbd6-c3c2-49d6-be57-806217c6a8c0 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:09.072557 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbffbd6-c3c2-49d6-be57-806217c6a8c0 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:09.072705 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbffbd6-c3c2-49d6-be57-806217c6a8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:09.089319 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-6cbffbd6-c3c2-49d6-be57-806217c6a8c0 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:42:09.090543 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-6cbffbd6-c3c2-49d6-be57-806217c6a8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:42:09.167207 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 446/918] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:42:09 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:42:09.192834 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778fbf5-2ef6-4229-9173-9bb29183ca84 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:09.313419 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c778fbf5-2ef6-4229-9173-9bb29183ca84 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:09.351997 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbcd63-362a-460d-9d62-4ff49fc3de13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:09.352747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbcd63-362a-460d-9d62-4ff49fc3de13 None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:09.353028 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbcd63-362a-460d-9d62-4ff49fc3de13 None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:09.353301 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dbcd63-362a-460d-9d62-4ff49fc3de13 None admin] PATH_INFO: `/v3/services/placement` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:09.353959 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbcd63-362a-460d-9d62-4ff49fc3de13 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:09.355345 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dbcd63-362a-460d-9d62-4ff49fc3de13 None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:09.368167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-52dbcd63-362a-460d-9d62-4ff49fc3de13 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:42:09.368167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:42:09.368167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:42:09.368167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:42:09.368167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:42:09.368167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:42:09.368167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:42:09.368167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:42:09.368167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:42:09.368167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:42:09.368167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:42:09.368167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:42:09.368167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:42:09.368167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:42:09.368167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:42:09.368167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:42:09.368167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:42:09.369562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:42:09.369562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:42:09.369562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:42:09.369562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:42:09.369562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:42:09.369562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:42:09.369562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:42:09.369562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:42:09.369562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:42:09.369562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:42:09.369562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:42:09.369562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:42:09.369562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:42:09.369562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:42:09.369562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:42:09.369562 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:42:09.370450 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:42:09.370450 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:42:09.370450 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:42:09.370450 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:42:09.370450 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:42:09.370450 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:42:09.370450 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:42:09.370450 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:42:09.370450 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:42:09.370450 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:42:09.370450 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:42:09.370450 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:42:09.370450 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:42:09.370450 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:42:09.370450 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 473/919] 10.222.0.62 () {56 vars in 1117 bytes} [Wed May 25 15:42:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:42:09.377159 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbffbd6-c3c2-49d6-be57-806217c6a8c0 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:09.398930 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:09.489058 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbffbd6-c3c2-49d6-be57-806217c6a8c0 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:09.526105 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4f787-ad08-4232-93e5-0488919b8055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:09.526782 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4f787-ad08-4232-93e5-0488919b8055 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:09.527064 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4f787-ad08-4232-93e5-0488919b8055 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:09.527341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce4f787-ad08-4232-93e5-0488919b8055 None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:09.528059 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4f787-ad08-4232-93e5-0488919b8055 None admin] RBAC: Adding query filter params (name=placement) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:42:09.528362 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4f787-ad08-4232-93e5-0488919b8055 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:09.530181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce4f787-ad08-4232-93e5-0488919b8055 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:09.535823 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 447/920] 10.222.0.62 () {56 vars in 1116 bytes} [Wed May 25 15:42:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:42:09.543369 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbcd63-362a-460d-9d62-4ff49fc3de13 None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:09.574328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:09.653901 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dbcd63-362a-460d-9d62-4ff49fc3de13 None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:09.692624 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd409da-e8ee-4526-99d5-76b58184f9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:09.693320 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd409da-e8ee-4526-99d5-76b58184f9ac None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:09.694202 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd409da-e8ee-4526-99d5-76b58184f9ac None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:09.695051 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd409da-e8ee-4526-99d5-76b58184f9ac None admin] PATH_INFO: `/v3/endpoints` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:09.695855 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd409da-e8ee-4526-99d5-76b58184f9ac None admin] RBAC: Adding query filter params (interface=public, service_id=8575e8deb4fd4dffb925ada6ab00fdcd, region_id=RegionOne) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:42:09.696171 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd409da-e8ee-4526-99d5-76b58184f9ac None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:09.697680 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd409da-e8ee-4526-99d5-76b58184f9ac None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:09.703229 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 474/921] 10.222.0.62 () {56 vars in 1251 bytes} [Wed May 25 15:42:09 2022] GET /identity/v3/endpoints?service_id=8575e8deb4fd4dffb925ada6ab00fdcd&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:42:09.710148 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4f787-ad08-4232-93e5-0488919b8055 None admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:09.790827 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:09.808717 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce4f787-ad08-4232-93e5-0488919b8055 None admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:09.850632 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec585a-02af-4344-a522-5fd8cc898493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:09.851329 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec585a-02af-4344-a522-5fd8cc898493 None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:09.851615 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec585a-02af-4344-a522-5fd8cc898493 None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:09.851884 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec585a-02af-4344-a522-5fd8cc898493 None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:09.852583 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec585a-02af-4344-a522-5fd8cc898493 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:09.853967 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec585a-02af-4344-a522-5fd8cc898493 None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:09.860445 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 448/922] 10.222.0.62 () {56 vars in 1087 bytes} [Wed May 25 15:42:09 2022] GET /identity/v3/services => generated 1962 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:42:12.115137 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e88e2-eac4-4a2e-8fc1-09e914fa8193 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:12.116206 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e88e2-eac4-4a2e-8fc1-09e914fa8193 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:12.116593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0e88e2-eac4-4a2e-8fc1-09e914fa8193 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:12.118080 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 475/923] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:42:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:42:12.123446 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600cbe9-37cc-43d6-a93b-620317225a4f None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:12.123968 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600cbe9-37cc-43d6-a93b-620317225a4f None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:12.124058 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600cbe9-37cc-43d6-a93b-620317225a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:12.142100 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-d600cbe9-37cc-43d6-a93b-620317225a4f None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:42:12.143288 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-d600cbe9-37cc-43d6-a93b-620317225a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:42:12.212346 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 449/924] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:42:12 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 15:42:12.236792 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e88e2-eac4-4a2e-8fc1-09e914fa8193 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:12.329370 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:12.339268 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0e88e2-eac4-4a2e-8fc1-09e914fa8193 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:12.376439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda0e72-10c0-430b-a61e-74307ac3e4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:12.376439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda0e72-10c0-430b-a61e-74307ac3e4da None admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:12.376439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda0e72-10c0-430b-a61e-74307ac3e4da None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:12.376439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfda0e72-10c0-430b-a61e-74307ac3e4da None admin] PATH_INFO: `/v3/services/placement` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:12.376845 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda0e72-10c0-430b-a61e-74307ac3e4da None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:12.376845 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfda0e72-10c0-430b-a61e-74307ac3e4da None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:12.387723 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application [None req-dfda0e72-10c0-430b-a61e-74307ac3e4da None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:42:12.387723 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:42:12.387723 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 15:42:12.387723 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 15:42:12.387723 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 15:42:12.387723 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 15:42:12.387723 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 15:42:12.387723 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:42:12.387723 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:42:12.387723 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:42:12.387723 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 15:42:12.387723 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:42:12.387723 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 15:42:12.387723 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 15:42:12.387723 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 15:42:12.387723 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 15:42:12.387723 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 15:42:12.388981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 15:42:12.388981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 15:42:12.388981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 15:42:12.388981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 15:42:12.388981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 15:42:12.388981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 15:42:12.388981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 15:42:12.388981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 15:42:12.388981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 15:42:12.388981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 15:42:12.388981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 15:42:12.388981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 15:42:12.388981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 15:42:12.388981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 15:42:12.388981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 15:42:12.388981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.get_or_create( May 25 15:42:12.390106 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 15:42:12.390106 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application with Lock( May 25 15:42:12.390106 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 15:42:12.390106 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self._enter() May 25 15:42:12.390106 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 15:42:12.390106 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 15:42:12.390106 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 15:42:12.390106 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application return self.creator() May 25 15:42:12.390106 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 15:42:12.390106 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application created_value = creator( May 25 15:42:12.390106 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 15:42:12.390106 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 15:42:12.390106 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 15:42:12.390106 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: ERROR keystone.server.flask.application May 25 15:42:12.390106 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 476/925] 10.222.0.62 () {56 vars in 1117 bytes} [Wed May 25 15:42:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 15:42:12.396479 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600cbe9-37cc-43d6-a93b-620317225a4f None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:12.473082 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:12.495733 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600cbe9-37cc-43d6-a93b-620317225a4f None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:12.530730 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76218042-4466-4107-aa37-419d6ecfc9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:12.531395 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76218042-4466-4107-aa37-419d6ecfc9fa None admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:12.531680 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76218042-4466-4107-aa37-419d6ecfc9fa None admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:12.531957 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76218042-4466-4107-aa37-419d6ecfc9fa None admin] PATH_INFO: `/v3/services` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:12.532692 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76218042-4466-4107-aa37-419d6ecfc9fa None admin] RBAC: Adding query filter params (name=placement) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:42:12.533006 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76218042-4466-4107-aa37-419d6ecfc9fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:12.534409 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76218042-4466-4107-aa37-419d6ecfc9fa None admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:12.540341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 450/926] 10.222.0.62 () {56 vars in 1116 bytes} [Wed May 25 15:42:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:42:12.546207 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda0e72-10c0-430b-a61e-74307ac3e4da None admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:42:12.645146 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfda0e72-10c0-430b-a61e-74307ac3e4da None admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:42:12.677754 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254eca8b-7a02-4399-ba4f-eaf6735b9d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:42:12.678404 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eca8b-7a02-4399-ba4f-eaf6735b9d6f None admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:42:12.678685 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eca8b-7a02-4399-ba4f-eaf6735b9d6f None admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:42:12.678958 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254eca8b-7a02-4399-ba4f-eaf6735b9d6f None admin] PATH_INFO: `/v3/endpoints` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:42:12.679682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254eca8b-7a02-4399-ba4f-eaf6735b9d6f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:42:12.681067 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254eca8b-7a02-4399-ba4f-eaf6735b9d6f None admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:42:12.770737 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 477/927] 10.222.0.62 () {60 vars in 1144 bytes} [Wed May 25 15:42:12 2022] POST /identity/v3/endpoints => generated 331 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:42:22.536632 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=30 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:42:22.766113 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:49:37.011919 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a17ade-f0f1-4173-b110-1cf1ba56131d None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:37.011919 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a17ade-f0f1-4173-b110-1cf1ba56131d None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:37.011919 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a17ade-f0f1-4173-b110-1cf1ba56131d None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:37.018283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35263059-a83a-43ec-ae5f-fc0b0a81cb2a None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:37.018283 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35263059-a83a-43ec-ae5f-fc0b0a81cb2a None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:37.019621 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35263059-a83a-43ec-ae5f-fc0b0a81cb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:37.020708 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 451/928] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:49:37 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:49:37.130628 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-35263059-a83a-43ec-ae5f-fc0b0a81cb2a None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:49:37.131112 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-35263059-a83a-43ec-ae5f-fc0b0a81cb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:49:37.245644 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 478/929] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:49:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:49:37.299198 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f788d-7002-4d2c-be46-c0e61ca4725d None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:37.299494 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f788d-7002-4d2c-be46-c0e61ca4725d None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:37.299808 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54f788d-7002-4d2c-be46-c0e61ca4725d None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:37.301385 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 452/930] 10.222.0.62 () {54 vars in 964 bytes} [Wed May 25 15:49:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:49:37.307521 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad06b7-d8f4-4047-a670-128768e6f572 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:37.308070 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad06b7-d8f4-4047-a670-128768e6f572 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:37.308247 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ad06b7-d8f4-4047-a670-128768e6f572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:37.387429 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-28ad06b7-d8f4-4047-a670-128768e6f572 None None] MFA Rules not processed for user `d1cb7a1be78c4b55b5ec991b99d47020`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:49:37.388716 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-28ad06b7-d8f4-4047-a670-128768e6f572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:49:37.429642 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:49:37.484044 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 479/931] 10.222.0.62 () {58 vars in 1061 bytes} [Wed May 25 15:49:37 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:49:37.494108 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f788d-7002-4d2c-be46-c0e61ca4725d None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:49:37.506169 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54f788d-7002-4d2c-be46-c0e61ca4725d None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:49:37.509808 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb698dd-ef23-4987-8cc3-060a2d5d45fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:49:37.510458 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb698dd-ef23-4987-8cc3-060a2d5d45fb service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:37.510761 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb698dd-ef23-4987-8cc3-060a2d5d45fb service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:37.511124 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb698dd-ef23-4987-8cc3-060a2d5d45fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:37.521919 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb698dd-ef23-4987-8cc3-060a2d5d45fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:49:37.523385 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb698dd-ef23-4987-8cc3-060a2d5d45fb service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:49:37.536745 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 453/932] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:49:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:49:40.136911 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340fd58-e5d5-4a52-b21a-cceb198cbccf None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:40.137327 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340fd58-e5d5-4a52-b21a-cceb198cbccf None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:40.137479 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340fd58-e5d5-4a52-b21a-cceb198cbccf None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:40.138852 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 480/933] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:49:40.145117 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ab79f-9d15-4578-b455-4a477d847af5 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:40.145601 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ab79f-9d15-4578-b455-4a477d847af5 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:40.145709 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633ab79f-9d15-4578-b455-4a477d847af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:40.164084 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-633ab79f-9d15-4578-b455-4a477d847af5 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:49:40.165321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-633ab79f-9d15-4578-b455-4a477d847af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:49:40.173209 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 454/934] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:49:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:49:40.234126 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8083c-c69d-4c04-9c09-e6538a27b3e7 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:40.234415 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8083c-c69d-4c04-9c09-e6538a27b3e7 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:40.234694 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b8083c-c69d-4c04-9c09-e6538a27b3e7 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:40.236121 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 481/935] 10.222.0.62 () {54 vars in 964 bytes} [Wed May 25 15:49:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:49:40.244347 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3424039-b3f0-44fb-abea-67e3a2aef6bd None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:40.244808 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3424039-b3f0-44fb-abea-67e3a2aef6bd None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:40.245271 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3424039-b3f0-44fb-abea-67e3a2aef6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:40.266843 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-c3424039-b3f0-44fb-abea-67e3a2aef6bd None None] MFA Rules not processed for user `d1cb7a1be78c4b55b5ec991b99d47020`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:49:40.268214 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-c3424039-b3f0-44fb-abea-67e3a2aef6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:49:40.276819 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 455/936] 10.222.0.62 () {58 vars in 1061 bytes} [Wed May 25 15:49:40 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:49:40.287706 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8083c-c69d-4c04-9c09-e6538a27b3e7 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:49:40.299321 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b8083c-c69d-4c04-9c09-e6538a27b3e7 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:49:40.303467 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92687c9-6f63-4e9f-94e2-0ee4151457bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:49:40.304251 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92687c9-6f63-4e9f-94e2-0ee4151457bc service neutron] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:40.304642 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92687c9-6f63-4e9f-94e2-0ee4151457bc service neutron] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:40.304985 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92687c9-6f63-4e9f-94e2-0ee4151457bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:40.315458 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92687c9-6f63-4e9f-94e2-0ee4151457bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:49:40.317019 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92687c9-6f63-4e9f-94e2-0ee4151457bc service neutron] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:49:40.327846 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 482/937] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:49:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:49:43.406720 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a8a28-0f25-48df-a352-95e2571c4c1e None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:43.407763 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a8a28-0f25-48df-a352-95e2571c4c1e None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:43.407763 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726a8a28-0f25-48df-a352-95e2571c4c1e None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:43.410064 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 456/938] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:49:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:49:43.416684 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a5ac6-fc74-4357-bbc3-ac3e940edea8 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:43.417433 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a5ac6-fc74-4357-bbc3-ac3e940edea8 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:43.417433 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a5ac6-fc74-4357-bbc3-ac3e940edea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:43.490942 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-de5a5ac6-fc74-4357-bbc3-ac3e940edea8 None None] MFA Rules not processed for user `f6c5e41e9bbe4c8e8a2622938ac4f876`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:49:43.492200 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-de5a5ac6-fc74-4357-bbc3-ac3e940edea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:49:43.590256 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 483/939] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:49:43 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:49:43.634725 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a8a28-0f25-48df-a352-95e2571c4c1e None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:49:43.646783 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726a8a28-0f25-48df-a352-95e2571c4c1e None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:49:43.651458 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb60ca1-64fa-4b91-8e18-b2d9dfe7e233 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:49:43.652118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb60ca1-64fa-4b91-8e18-b2d9dfe7e233 service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:43.652449 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb60ca1-64fa-4b91-8e18-b2d9dfe7e233 service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:43.652727 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb60ca1-64fa-4b91-8e18-b2d9dfe7e233 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:43.664136 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb60ca1-64fa-4b91-8e18-b2d9dfe7e233 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:49:43.665561 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb60ca1-64fa-4b91-8e18-b2d9dfe7e233 service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:49:43.681854 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 457/940] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:49:43 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:49:47.188922 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a030c9-5a40-424a-8d19-7167395ef5fc None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:47.189513 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a030c9-5a40-424a-8d19-7167395ef5fc None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:47.189513 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a030c9-5a40-424a-8d19-7167395ef5fc None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:47.191035 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 484/941] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:49:47.196620 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972f3c0-571d-42d4-a28b-d8e84888d3fa None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:47.197190 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972f3c0-571d-42d4-a28b-d8e84888d3fa None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:47.197190 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972f3c0-571d-42d4-a28b-d8e84888d3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:47.215295 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-8972f3c0-571d-42d4-a28b-d8e84888d3fa None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:49:47.216534 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-8972f3c0-571d-42d4-a28b-d8e84888d3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:49:47.293168 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 458/942] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:49:47 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:49:47.335543 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a030c9-5a40-424a-8d19-7167395ef5fc None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:49:47.346088 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a030c9-5a40-424a-8d19-7167395ef5fc None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:49:47.349780 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cef9d-fd40-4092-918a-c6cb6cf37445 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:49:47.350423 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cef9d-fd40-4092-918a-c6cb6cf37445 service neutron] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:47.350704 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cef9d-fd40-4092-918a-c6cb6cf37445 service neutron] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:47.350975 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cef9d-fd40-4092-918a-c6cb6cf37445 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:47.360636 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cef9d-fd40-4092-918a-c6cb6cf37445 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:49:47.362309 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cef9d-fd40-4092-918a-c6cb6cf37445 service neutron] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:49:47.372135 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 485/943] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:49:47 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:49:50.752259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93b3b4-289b-4ee1-8c7b-3203bd23274f None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:50.752825 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93b3b4-289b-4ee1-8c7b-3203bd23274f None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:50.752934 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab93b3b4-289b-4ee1-8c7b-3203bd23274f None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:50.754422 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 459/944] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:49:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:49:50.760079 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40810a59-d3e3-4638-88bf-fe43637dadf8 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:50.760601 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40810a59-d3e3-4638-88bf-fe43637dadf8 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:50.760810 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40810a59-d3e3-4638-88bf-fe43637dadf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:50.779379 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-40810a59-d3e3-4638-88bf-fe43637dadf8 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:49:50.780667 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-40810a59-d3e3-4638-88bf-fe43637dadf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:49:50.789975 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 486/945] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:49:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:49:50.828403 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93b3b4-289b-4ee1-8c7b-3203bd23274f None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:49:50.840746 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab93b3b4-289b-4ee1-8c7b-3203bd23274f None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:49:50.844362 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6dffba-9cf5-4474-bc76-1e7a7cd64ef9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:49:50.845127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dffba-9cf5-4474-bc76-1e7a7cd64ef9 service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:50.845414 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dffba-9cf5-4474-bc76-1e7a7cd64ef9 service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:50.845783 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dffba-9cf5-4474-bc76-1e7a7cd64ef9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:50.856640 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6dffba-9cf5-4474-bc76-1e7a7cd64ef9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:49:50.858090 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6dffba-9cf5-4474-bc76-1e7a7cd64ef9 service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:49:50.870082 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 460/946] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:49:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:49:53.256612 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53971b2-2dba-49af-81c4-58c8f45b91ed None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:53.257123 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53971b2-2dba-49af-81c4-58c8f45b91ed None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:53.257348 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53971b2-2dba-49af-81c4-58c8f45b91ed None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:53.258747 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 487/947] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:49:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:49:53.264357 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c347c5-e548-4988-afe7-5e083fd26778 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:53.265011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c347c5-e548-4988-afe7-5e083fd26778 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:53.265011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c347c5-e548-4988-afe7-5e083fd26778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:53.285553 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-d2c347c5-e548-4988-afe7-5e083fd26778 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:49:53.286759 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-d2c347c5-e548-4988-afe7-5e083fd26778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:49:53.298167 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 461/948] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:49:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:49:53.338582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53971b2-2dba-49af-81c4-58c8f45b91ed None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:49:53.350135 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53971b2-2dba-49af-81c4-58c8f45b91ed None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:49:53.353773 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac39d1d-a1fb-4dc6-a2c7-5305180307ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:49:53.354711 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac39d1d-a1fb-4dc6-a2c7-5305180307ca service neutron] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:53.354711 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac39d1d-a1fb-4dc6-a2c7-5305180307ca service neutron] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:53.354978 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac39d1d-a1fb-4dc6-a2c7-5305180307ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:53.364465 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac39d1d-a1fb-4dc6-a2c7-5305180307ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:49:53.365921 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac39d1d-a1fb-4dc6-a2c7-5305180307ca service neutron] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:49:53.376559 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 488/949] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:49:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:49:55.747818 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7adcc5-81c5-4146-a93b-75c364891164 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:55.748382 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7adcc5-81c5-4146-a93b-75c364891164 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:55.748382 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7adcc5-81c5-4146-a93b-75c364891164 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:55.749785 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 462/950] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:49:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:49:55.756518 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6bc39-6831-40a1-b548-00b56929cfa0 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:55.757088 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6bc39-6831-40a1-b548-00b56929cfa0 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:55.757088 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6bc39-6831-40a1-b548-00b56929cfa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:55.776633 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-add6bc39-6831-40a1-b548-00b56929cfa0 None None] MFA Rules not processed for user `f6c5e41e9bbe4c8e8a2622938ac4f876`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:49:55.777829 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-add6bc39-6831-40a1-b548-00b56929cfa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:49:55.785918 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 489/951] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:49:55 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:49:55.825804 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7adcc5-81c5-4146-a93b-75c364891164 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:49:55.837107 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7adcc5-81c5-4146-a93b-75c364891164 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:49:55.840680 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5529e205-6451-44ba-aecc-86c5d58076d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:49:55.841321 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529e205-6451-44ba-aecc-86c5d58076d9 service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:55.841606 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529e205-6451-44ba-aecc-86c5d58076d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:55.844670 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5529e205-6451-44ba-aecc-86c5d58076d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:55.851824 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529e205-6451-44ba-aecc-86c5d58076d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:49:55.853295 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5529e205-6451-44ba-aecc-86c5d58076d9 service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:49:55.863807 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 463/952] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:49:55 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:49:58.640663 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef1509-0144-444c-8941-5b145cf005b3 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:58.641274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef1509-0144-444c-8941-5b145cf005b3 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:58.641274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef1509-0144-444c-8941-5b145cf005b3 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:58.642796 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 490/953] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:49:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:49:58.648089 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fbcb5-a32a-4394-82b0-9b5c6d03c9ae None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:58.648568 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fbcb5-a32a-4394-82b0-9b5c6d03c9ae None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:58.648831 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3fbcb5-a32a-4394-82b0-9b5c6d03c9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:58.667308 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-5f3fbcb5-a32a-4394-82b0-9b5c6d03c9ae None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:49:58.668541 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-5f3fbcb5-a32a-4394-82b0-9b5c6d03c9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:49:58.677050 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 464/954] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:49:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:49:58.715332 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef1509-0144-444c-8941-5b145cf005b3 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:49:58.726787 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afef1509-0144-444c-8941-5b145cf005b3 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:49:58.730776 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db2ddaab-b503-428b-b4c3-8a8722999d50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:49:58.731225 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ddaab-b503-428b-b4c3-8a8722999d50 service neutron] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:49:58.731511 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ddaab-b503-428b-b4c3-8a8722999d50 service neutron] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:49:58.731788 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db2ddaab-b503-428b-b4c3-8a8722999d50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:49:58.742091 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ddaab-b503-428b-b4c3-8a8722999d50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:49:58.743784 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db2ddaab-b503-428b-b4c3-8a8722999d50 service neutron] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:49:58.748030 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:49:58.755875 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 491/955] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:49:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:50:01.134016 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4e018-eeca-4d51-b4e4-636ad7ee8f3c None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:01.134544 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4e018-eeca-4d51-b4e4-636ad7ee8f3c None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:01.135109 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4e018-eeca-4d51-b4e4-636ad7ee8f3c None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:01.135952 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 465/956] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:50:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:50:01.142000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fa725-dfef-4f1e-9969-09fee532e9bc None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:01.143082 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fa725-dfef-4f1e-9969-09fee532e9bc None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:01.143082 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812fa725-dfef-4f1e-9969-09fee532e9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:01.161966 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-812fa725-dfef-4f1e-9969-09fee532e9bc None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:50:01.163263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-812fa725-dfef-4f1e-9969-09fee532e9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:50:01.171064 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 492/957] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:50:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:50:01.213657 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4e018-eeca-4d51-b4e4-636ad7ee8f3c None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:50:01.225108 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4e018-eeca-4d51-b4e4-636ad7ee8f3c None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:50:01.228922 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfb10a-8959-4229-80f3-2eb108f745b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:50:01.229625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfb10a-8959-4229-80f3-2eb108f745b3 service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:01.229965 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfb10a-8959-4229-80f3-2eb108f745b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:01.230299 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfb10a-8959-4229-80f3-2eb108f745b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:01.240619 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfb10a-8959-4229-80f3-2eb108f745b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:50:01.242086 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfb10a-8959-4229-80f3-2eb108f745b3 service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:50:01.253127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 466/958] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:50:01 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:50:04.247287 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f921727-7dcb-4da3-8913-d4d1e0ba2915 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:04.248033 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f921727-7dcb-4da3-8913-d4d1e0ba2915 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:04.248033 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f921727-7dcb-4da3-8913-d4d1e0ba2915 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:04.249221 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 493/959] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:50:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:50:04.255001 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2722d-fa39-4fba-a2f6-08279fd40ff4 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:04.255461 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2722d-fa39-4fba-a2f6-08279fd40ff4 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:04.255574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c2722d-fa39-4fba-a2f6-08279fd40ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:04.262761 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=74 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:50:04.275469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-f0c2722d-fa39-4fba-a2f6-08279fd40ff4 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:50:04.276715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-f0c2722d-fa39-4fba-a2f6-08279fd40ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:50:04.286032 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 467/960] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:50:04 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:50:04.322117 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f921727-7dcb-4da3-8913-d4d1e0ba2915 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:50:04.333352 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f921727-7dcb-4da3-8913-d4d1e0ba2915 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:50:04.336856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cd76b3-41f3-474c-a652-1816c7202a36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:50:04.337494 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd76b3-41f3-474c-a652-1816c7202a36 service neutron] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:04.337776 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd76b3-41f3-474c-a652-1816c7202a36 service neutron] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:04.338052 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cd76b3-41f3-474c-a652-1816c7202a36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:04.347814 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd76b3-41f3-474c-a652-1816c7202a36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:50:04.349282 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cd76b3-41f3-474c-a652-1816c7202a36 service neutron] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:50:04.359147 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 494/961] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:50:04 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:50:09.159277 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec06301-7833-4262-954a-5f2f28dd1d10 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:09.160101 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec06301-7833-4262-954a-5f2f28dd1d10 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:09.160101 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec06301-7833-4262-954a-5f2f28dd1d10 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:09.161151 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 468/962] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:50:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:50:09.168999 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfe2c7-fac5-4fbb-972c-d91f18d7edca None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:09.169905 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfe2c7-fac5-4fbb-972c-d91f18d7edca None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:09.170396 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cfe2c7-fac5-4fbb-972c-d91f18d7edca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:09.190360 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-04cfe2c7-fac5-4fbb-972c-d91f18d7edca None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:50:09.191814 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-04cfe2c7-fac5-4fbb-972c-d91f18d7edca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:50:09.200316 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 495/963] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:50:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:50:09.241814 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec06301-7833-4262-954a-5f2f28dd1d10 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:50:09.253613 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec06301-7833-4262-954a-5f2f28dd1d10 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:50:09.257111 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd624e-468a-443a-b9ca-8bc54f25fbf9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:50:09.257754 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd624e-468a-443a-b9ca-8bc54f25fbf9 service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:09.258037 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd624e-468a-443a-b9ca-8bc54f25fbf9 service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:09.258310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd624e-468a-443a-b9ca-8bc54f25fbf9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:09.268562 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd624e-468a-443a-b9ca-8bc54f25fbf9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:50:09.269998 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd624e-468a-443a-b9ca-8bc54f25fbf9 service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:50:09.279517 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 469/964] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:50:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:50:12.688831 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce409e0-2fe3-4af5-8a9c-2ab882369b92 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:12.689380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce409e0-2fe3-4af5-8a9c-2ab882369b92 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:12.689380 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce409e0-2fe3-4af5-8a9c-2ab882369b92 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:12.690759 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 496/965] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:50:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:50:12.696367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cc1a9-0294-485a-8d9f-8da215f2b1f9 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:12.696851 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cc1a9-0294-485a-8d9f-8da215f2b1f9 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:12.696967 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320cc1a9-0294-485a-8d9f-8da215f2b1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:12.716191 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-320cc1a9-0294-485a-8d9f-8da215f2b1f9 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:50:12.717426 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-320cc1a9-0294-485a-8d9f-8da215f2b1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:50:12.725434 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 470/966] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:50:12 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:50:12.763678 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce409e0-2fe3-4af5-8a9c-2ab882369b92 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:50:12.775504 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce409e0-2fe3-4af5-8a9c-2ab882369b92 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:50:12.779180 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedfd9bb-b72b-4c7a-91bb-0776a51aeeac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:50:12.779918 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfd9bb-b72b-4c7a-91bb-0776a51aeeac service neutron] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:12.780272 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfd9bb-b72b-4c7a-91bb-0776a51aeeac service neutron] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:12.780746 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedfd9bb-b72b-4c7a-91bb-0776a51aeeac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:12.791129 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfd9bb-b72b-4c7a-91bb-0776a51aeeac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:50:12.792606 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedfd9bb-b72b-4c7a-91bb-0776a51aeeac service neutron] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:50:12.802629 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 497/967] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:50:12 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:50:17.527300 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa50d3-35b6-400b-a55c-654089ec9e74 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:17.527826 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa50d3-35b6-400b-a55c-654089ec9e74 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:17.527826 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45fa50d3-35b6-400b-a55c-654089ec9e74 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:17.529285 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 471/968] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:50:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:50:17.535114 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcea1b0-fff3-499d-aa94-0fcf5faa9112 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:17.535550 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcea1b0-fff3-499d-aa94-0fcf5faa9112 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:17.535663 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcea1b0-fff3-499d-aa94-0fcf5faa9112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:17.554045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-7dcea1b0-fff3-499d-aa94-0fcf5faa9112 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:50:17.555249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-7dcea1b0-fff3-499d-aa94-0fcf5faa9112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:50:17.563319 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 498/969] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:50:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:50:17.602521 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa50d3-35b6-400b-a55c-654089ec9e74 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:50:17.614366 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45fa50d3-35b6-400b-a55c-654089ec9e74 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:50:17.618211 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bea3a7a-8e5c-4df6-9a36-5652803bc5cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:50:17.618879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea3a7a-8e5c-4df6-9a36-5652803bc5cd service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:17.619168 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea3a7a-8e5c-4df6-9a36-5652803bc5cd service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:17.619491 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bea3a7a-8e5c-4df6-9a36-5652803bc5cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:17.628885 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea3a7a-8e5c-4df6-9a36-5652803bc5cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:50:17.632308 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bea3a7a-8e5c-4df6-9a36-5652803bc5cd service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:50:17.640655 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 472/970] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:50:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:50:23.377140 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce61cd-585b-4a1b-9b83-d8c341a3456b None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:23.377675 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce61cd-585b-4a1b-9b83-d8c341a3456b None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:23.377675 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce61cd-585b-4a1b-9b83-d8c341a3456b None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:23.379534 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 499/971] 10.222.0.62 () {54 vars in 921 bytes} [Wed May 25 15:50:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:50:23.389317 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3f389-82c4-4925-8cd6-dca255b31a94 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:23.399562 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3f389-82c4-4925-8cd6-dca255b31a94 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:23.399562 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc3f389-82c4-4925-8cd6-dca255b31a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:23.447698 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-8dc3f389-82c4-4925-8cd6-dca255b31a94 None None] MFA Rules not processed for user `2506613903044131b9e8c75196de862b`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:50:23.449200 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-8dc3f389-82c4-4925-8cd6-dca255b31a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:50:23.539577 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 473/972] 10.222.0.62 () {58 vars in 1018 bytes} [Wed May 25 15:50:23 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:50:27.549718 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=22 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:50:28.236779 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a2e8e-34db-4640-8d3c-0658cf9fb17a None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:28.237205 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a2e8e-34db-4640-8d3c-0658cf9fb17a None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:28.237333 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8a2e8e-34db-4640-8d3c-0658cf9fb17a None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:28.238879 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 500/973] 10.222.0.62 () {54 vars in 921 bytes} [Wed May 25 15:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:50:28.245897 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf69e8-e49f-4240-9a79-73c0d9c49028 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:28.246863 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf69e8-e49f-4240-9a79-73c0d9c49028 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:28.247493 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf69e8-e49f-4240-9a79-73c0d9c49028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:28.269597 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-afdf69e8-e49f-4240-9a79-73c0d9c49028 None None] MFA Rules not processed for user `2506613903044131b9e8c75196de862b`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:50:28.271396 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-afdf69e8-e49f-4240-9a79-73c0d9c49028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:50:28.281940 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 474/974] 10.222.0.62 () {58 vars in 1018 bytes} [Wed May 25 15:50:28 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:50:29.658938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a9cc2-ed64-4079-bb01-a210f83a2a30 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:29.659499 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a9cc2-ed64-4079-bb01-a210f83a2a30 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:29.659499 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a9cc2-ed64-4079-bb01-a210f83a2a30 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:29.661151 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 501/975] 10.222.0.62 () {54 vars in 921 bytes} [Wed May 25 15:50:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:50:29.666899 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a611756-cb63-4d60-bd5a-3cdde44a77bf None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:29.667399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a611756-cb63-4d60-bd5a-3cdde44a77bf None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:29.667770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a611756-cb63-4d60-bd5a-3cdde44a77bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:29.689373 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-9a611756-cb63-4d60-bd5a-3cdde44a77bf None None] MFA Rules not processed for user `2506613903044131b9e8c75196de862b`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:50:29.690676 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-9a611756-cb63-4d60-bd5a-3cdde44a77bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:50:29.699484 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 475/976] 10.222.0.62 () {58 vars in 1018 bytes} [Wed May 25 15:50:29 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:50:33.721002 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec45b2a-c409-4ef0-b574-b6f80aeb5b28 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:33.721539 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec45b2a-c409-4ef0-b574-b6f80aeb5b28 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:33.721539 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec45b2a-c409-4ef0-b574-b6f80aeb5b28 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:33.723097 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 502/977] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:50:33.728238 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8da5c-402b-4dbb-8753-66c129de2534 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:33.728943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8da5c-402b-4dbb-8753-66c129de2534 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:33.728943 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c8da5c-402b-4dbb-8753-66c129de2534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:33.752095 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-64c8da5c-402b-4dbb-8753-66c129de2534 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:50:33.753387 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-64c8da5c-402b-4dbb-8753-66c129de2534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:50:33.761900 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 476/978] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:50:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:50:33.820703 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291dfe3-50fa-450f-8160-c80b0ead9106 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:33.821214 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291dfe3-50fa-450f-8160-c80b0ead9106 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:33.821712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9291dfe3-50fa-450f-8160-c80b0ead9106 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:33.823744 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 503/979] 10.222.0.62 () {54 vars in 961 bytes} [Wed May 25 15:50:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:50:33.831569 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3abca7-4614-42d1-8e62-5829b73cb2eb None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:33.832825 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3abca7-4614-42d1-8e62-5829b73cb2eb None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:33.832825 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3abca7-4614-42d1-8e62-5829b73cb2eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:33.887297 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-fb3abca7-4614-42d1-8e62-5829b73cb2eb None None] MFA Rules not processed for user `d9b8b255e35c4949ba8faeb79921f141`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:50:33.888903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-fb3abca7-4614-42d1-8e62-5829b73cb2eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:50:33.948165 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:50:33.975349 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 477/980] 10.222.0.62 () {58 vars in 1058 bytes} [Wed May 25 15:50:33 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:50:33.985981 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291dfe3-50fa-450f-8160-c80b0ead9106 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:50:34.002787 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9291dfe3-50fa-450f-8160-c80b0ead9106 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:50:34.009789 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d624d-073b-4085-9d16-271c5d048794 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:50:34.011228 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d624d-073b-4085-9d16-271c5d048794 service nova] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:34.011228 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d624d-073b-4085-9d16-271c5d048794 service nova] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:34.011661 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d624d-073b-4085-9d16-271c5d048794 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:34.021594 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d624d-073b-4085-9d16-271c5d048794 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:50:34.023273 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71d624d-073b-4085-9d16-271c5d048794 service nova] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:50:34.035565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 504/981] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:50:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:50:36.574481 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33db8ee-a8ae-4071-abd1-dc6c105ee291 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:36.574993 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33db8ee-a8ae-4071-abd1-dc6c105ee291 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:36.574993 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33db8ee-a8ae-4071-abd1-dc6c105ee291 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:36.576576 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 478/982] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:50:36.582561 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995e211-f2dc-4b26-80f5-b1fe26a45e3d None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:36.583078 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995e211-f2dc-4b26-80f5-b1fe26a45e3d None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:36.583164 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d995e211-f2dc-4b26-80f5-b1fe26a45e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:36.601458 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-d995e211-f2dc-4b26-80f5-b1fe26a45e3d None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:50:36.602688 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-d995e211-f2dc-4b26-80f5-b1fe26a45e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:50:36.613059 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 505/983] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:50:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:50:36.658996 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33db8ee-a8ae-4071-abd1-dc6c105ee291 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:50:36.676173 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33db8ee-a8ae-4071-abd1-dc6c105ee291 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:50:36.684492 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b26012-1206-4a9a-b9c8-3bc26a0480a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:50:36.685591 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b26012-1206-4a9a-b9c8-3bc26a0480a7 service nova] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:36.686109 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b26012-1206-4a9a-b9c8-3bc26a0480a7 service nova] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:36.687661 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b26012-1206-4a9a-b9c8-3bc26a0480a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:36.703695 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b26012-1206-4a9a-b9c8-3bc26a0480a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:50:36.706786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b26012-1206-4a9a-b9c8-3bc26a0480a7 service nova] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:50:36.722956 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 479/984] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:50:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:50:39.807269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8734b-5450-4bb0-a565-798c779d8468 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:39.807931 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8734b-5450-4bb0-a565-798c779d8468 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:39.807931 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc8734b-5450-4bb0-a565-798c779d8468 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:39.809218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 506/985] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:50:39.814691 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca7424-2c95-4d27-8772-1d53b6407b2c None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:39.815122 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca7424-2c95-4d27-8772-1d53b6407b2c None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:39.815447 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca7424-2c95-4d27-8772-1d53b6407b2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:39.834156 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-04ca7424-2c95-4d27-8772-1d53b6407b2c None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:50:39.835392 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-04ca7424-2c95-4d27-8772-1d53b6407b2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:50:39.844048 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 480/986] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:50:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:50:39.893574 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a943d7-fa1b-40a8-b3e3-b2300c5b05a8 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:39.893861 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a943d7-fa1b-40a8-b3e3-b2300c5b05a8 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:39.894165 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a943d7-fa1b-40a8-b3e3-b2300c5b05a8 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:39.895663 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 507/987] 10.222.0.62 () {54 vars in 961 bytes} [Wed May 25 15:50:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:50:39.901407 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd115ca-92bf-40e1-bda3-53c8c157d595 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:39.901705 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd115ca-92bf-40e1-bda3-53c8c157d595 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:39.901991 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd115ca-92bf-40e1-bda3-53c8c157d595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:39.929810 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-ddd115ca-92bf-40e1-bda3-53c8c157d595 None None] MFA Rules not processed for user `d9b8b255e35c4949ba8faeb79921f141`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:50:39.931024 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-ddd115ca-92bf-40e1-bda3-53c8c157d595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:50:39.939806 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 481/988] 10.222.0.62 () {58 vars in 1058 bytes} [Wed May 25 15:50:39 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:50:39.947491 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a943d7-fa1b-40a8-b3e3-b2300c5b05a8 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:50:39.961317 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a943d7-fa1b-40a8-b3e3-b2300c5b05a8 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:50:39.966249 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845b82f4-954f-4a86-9679-ca789398c31e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:50:39.966890 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b82f4-954f-4a86-9679-ca789398c31e service nova] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:39.967175 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b82f4-954f-4a86-9679-ca789398c31e service nova] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:39.967449 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845b82f4-954f-4a86-9679-ca789398c31e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:39.977009 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b82f4-954f-4a86-9679-ca789398c31e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:50:39.978602 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845b82f4-954f-4a86-9679-ca789398c31e service nova] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:50:39.988884 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 508/989] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:50:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:50:42.599348 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e0f13-bdb2-413e-b6a3-7933fb31dc51 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:42.600274 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e0f13-bdb2-413e-b6a3-7933fb31dc51 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:42.600733 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482e0f13-bdb2-413e-b6a3-7933fb31dc51 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:42.609039 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965577e3-4045-4f57-be85-75b2d1c2ab14 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:42.610092 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965577e3-4045-4f57-be85-75b2d1c2ab14 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:42.610537 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965577e3-4045-4f57-be85-75b2d1c2ab14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:42.612165 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 482/990] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:50:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:50:42.631395 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-965577e3-4045-4f57-be85-75b2d1c2ab14 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:50:42.632911 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-965577e3-4045-4f57-be85-75b2d1c2ab14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:50:42.652910 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 509/991] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:50:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:50:42.695247 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e0f13-bdb2-413e-b6a3-7933fb31dc51 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:50:42.712149 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482e0f13-bdb2-413e-b6a3-7933fb31dc51 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:50:42.718374 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b34cf-1fba-4c38-ad8d-5c17c84c6a34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:50:42.719319 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b34cf-1fba-4c38-ad8d-5c17c84c6a34 service nova] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:42.719762 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b34cf-1fba-4c38-ad8d-5c17c84c6a34 service nova] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:42.720194 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b34cf-1fba-4c38-ad8d-5c17c84c6a34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:42.729822 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b34cf-1fba-4c38-ad8d-5c17c84c6a34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:50:42.731664 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098b34cf-1fba-4c38-ad8d-5c17c84c6a34 service nova] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:50:42.755575 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 483/992] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:50:42 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:50:44.231656 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3cad2-eb63-4114-b347-ab3e40bff25c None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:44.232080 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3cad2-eb63-4114-b347-ab3e40bff25c None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:44.232080 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3cad2-eb63-4114-b347-ab3e40bff25c None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:44.240452 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f717e5-8ba7-4d07-85e1-cc30f1e31bd0 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:44.240874 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f717e5-8ba7-4d07-85e1-cc30f1e31bd0 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:44.240954 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f717e5-8ba7-4d07-85e1-cc30f1e31bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:44.242503 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 510/993] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:50:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:50:44.265506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-55f717e5-8ba7-4d07-85e1-cc30f1e31bd0 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:50:44.268575 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-55f717e5-8ba7-4d07-85e1-cc30f1e31bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:50:44.278371 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 484/994] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:50:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:50:44.603137 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e25a0-8d74-40b8-b36c-81677ce7e913 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:44.603137 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e25a0-8d74-40b8-b36c-81677ce7e913 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:44.603137 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e25a0-8d74-40b8-b36c-81677ce7e913 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:44.604837 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 511/995] 10.222.0.62 () {54 vars in 963 bytes} [Wed May 25 15:50:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:50:44.609637 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c241e-1336-4148-8dc2-17083915ded7 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:44.617672 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c241e-1336-4148-8dc2-17083915ded7 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:44.617672 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7c241e-1336-4148-8dc2-17083915ded7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:44.665732 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-6f7c241e-1336-4148-8dc2-17083915ded7 None None] MFA Rules not processed for user `45fabc3594f64571a0b381990b7974f8`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:50:44.667291 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-6f7c241e-1336-4148-8dc2-17083915ded7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:50:44.734928 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 485/996] 10.222.0.62 () {58 vars in 1060 bytes} [Wed May 25 15:50:44 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:50:44.743079 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e25a0-8d74-40b8-b36c-81677ce7e913 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:50:44.755212 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e25a0-8d74-40b8-b36c-81677ce7e913 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:50:44.759048 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a101401-57a1-48d3-8ed8-bd958bcce56e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45fabc3594f64571a0b381990b7974f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:50:44.759775 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a101401-57a1-48d3-8ed8-bd958bcce56e service cinder] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:44.760136 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a101401-57a1-48d3-8ed8-bd958bcce56e service cinder] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:44.760521 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a101401-57a1-48d3-8ed8-bd958bcce56e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:44.771968 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a101401-57a1-48d3-8ed8-bd958bcce56e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:50:44.773592 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a101401-57a1-48d3-8ed8-bd958bcce56e service cinder] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:50:44.788820 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 512/997] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:50:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:50:45.593372 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bae97-96dd-48dc-8c9c-3289718d3712 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:45.593979 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bae97-96dd-48dc-8c9c-3289718d3712 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:45.593979 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bae97-96dd-48dc-8c9c-3289718d3712 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:45.595324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 486/998] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:50:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:50:45.601034 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f23b4-92f0-4110-bb6e-f2602e3645d5 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:45.601508 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f23b4-92f0-4110-bb6e-f2602e3645d5 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:45.606901 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208f23b4-92f0-4110-bb6e-f2602e3645d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:45.621510 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-208f23b4-92f0-4110-bb6e-f2602e3645d5 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:50:45.622690 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-208f23b4-92f0-4110-bb6e-f2602e3645d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:50:45.632318 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 513/999] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:50:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:50:45.684925 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bae97-96dd-48dc-8c9c-3289718d3712 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:50:45.701489 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bae97-96dd-48dc-8c9c-3289718d3712 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:50:45.706795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffdd059-f52a-4cdd-8923-b9a96d508b18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:50:45.707533 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdd059-f52a-4cdd-8923-b9a96d508b18 service nova] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:45.708035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdd059-f52a-4cdd-8923-b9a96d508b18 service nova] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:45.708603 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffdd059-f52a-4cdd-8923-b9a96d508b18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:45.718962 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdd059-f52a-4cdd-8923-b9a96d508b18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:50:45.720782 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffdd059-f52a-4cdd-8923-b9a96d508b18 service nova] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:50:45.730973 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 487/1000] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:50:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:50:48.250599 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e99240-2a9b-4145-8893-03d70952c075 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:48.251351 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e99240-2a9b-4145-8893-03d70952c075 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:48.252071 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e99240-2a9b-4145-8893-03d70952c075 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:48.253321 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 514/1001] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:50:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:50:48.259177 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a13125-922f-46cb-92b0-caeef1bccfec None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:48.259634 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a13125-922f-46cb-92b0-caeef1bccfec None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:48.259768 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a13125-922f-46cb-92b0-caeef1bccfec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:48.284470 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-f6a13125-922f-46cb-92b0-caeef1bccfec None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:50:48.285558 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-f6a13125-922f-46cb-92b0-caeef1bccfec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:50:48.293506 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 488/1002] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:50:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:50:48.339181 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e99240-2a9b-4145-8893-03d70952c075 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:50:48.355188 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e99240-2a9b-4145-8893-03d70952c075 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:50:48.360856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa5205-f77a-4802-bebc-553921b1dbed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:50:48.361493 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa5205-f77a-4802-bebc-553921b1dbed service nova] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:48.361774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa5205-f77a-4802-bebc-553921b1dbed service nova] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:48.362052 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa5205-f77a-4802-bebc-553921b1dbed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:48.370718 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa5205-f77a-4802-bebc-553921b1dbed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:50:48.372294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa5205-f77a-4802-bebc-553921b1dbed service nova] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:50:48.388375 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 515/1003] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:50:48 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:50:50.878699 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8fe59-d335-4fda-bf88-400955fc6885 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:50.879675 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8fe59-d335-4fda-bf88-400955fc6885 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:50.880189 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8fe59-d335-4fda-bf88-400955fc6885 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:50.884619 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 489/1004] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:50:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:50:50.888454 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27113277-16e8-4eed-a017-f5cfeecc387c None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:50.889691 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27113277-16e8-4eed-a017-f5cfeecc387c None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:50.890288 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27113277-16e8-4eed-a017-f5cfeecc387c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:50.911412 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-27113277-16e8-4eed-a017-f5cfeecc387c None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:50:50.913129 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-27113277-16e8-4eed-a017-f5cfeecc387c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:50:50.923697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 516/1005] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:50:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:50:50.969556 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8fe59-d335-4fda-bf88-400955fc6885 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:50:50.984755 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8fe59-d335-4fda-bf88-400955fc6885 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:50:50.990038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61bf319-1f64-4fc7-a80d-6e1076715caf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:50:50.990690 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bf319-1f64-4fc7-a80d-6e1076715caf service nova] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:50.990982 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bf319-1f64-4fc7-a80d-6e1076715caf service nova] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:50.991260 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bf319-1f64-4fc7-a80d-6e1076715caf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:51.001286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61bf319-1f64-4fc7-a80d-6e1076715caf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:50:51.002880 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61bf319-1f64-4fc7-a80d-6e1076715caf service nova] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:50:51.013130 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 490/1006] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:50:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:50:53.379850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299a3ff-2006-4baa-a098-97c4da7dc87d None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:53.380772 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299a3ff-2006-4baa-a098-97c4da7dc87d None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:53.381060 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d299a3ff-2006-4baa-a098-97c4da7dc87d None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:53.386004 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 517/1007] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:50:53 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:50:53.392848 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70799-926c-4f70-bc67-ea01c517039d None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:53.393323 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70799-926c-4f70-bc67-ea01c517039d None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:53.396292 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70799-926c-4f70-bc67-ea01c517039d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:53.413145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-00a70799-926c-4f70-bc67-ea01c517039d None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:50:53.414424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-00a70799-926c-4f70-bc67-ea01c517039d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:50:53.437421 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 491/1008] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:50:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:50:53.473857 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299a3ff-2006-4baa-a098-97c4da7dc87d None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:50:53.488483 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d299a3ff-2006-4baa-a098-97c4da7dc87d None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:50:53.493929 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d347c11-a51c-4672-9c83-844198695d9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:50:53.494548 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d347c11-a51c-4672-9c83-844198695d9a service nova] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:53.494855 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d347c11-a51c-4672-9c83-844198695d9a service nova] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:53.495153 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d347c11-a51c-4672-9c83-844198695d9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:53.507304 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d347c11-a51c-4672-9c83-844198695d9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:50:53.509007 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d347c11-a51c-4672-9c83-844198695d9a service nova] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:50:53.524623 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 518/1009] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:50:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:50:56.121090 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04b62f-c64b-412c-91af-52586e24de81 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:56.121090 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04b62f-c64b-412c-91af-52586e24de81 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:56.121090 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04b62f-c64b-412c-91af-52586e24de81 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:56.121090 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 492/1010] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:50:56.123842 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d7c80-f6a2-4070-b97b-6bfb644ea75c None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:56.123842 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d7c80-f6a2-4070-b97b-6bfb644ea75c None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:56.123842 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d7c80-f6a2-4070-b97b-6bfb644ea75c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:56.123842 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-c99d7c80-f6a2-4070-b97b-6bfb644ea75c None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:50:56.123842 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-c99d7c80-f6a2-4070-b97b-6bfb644ea75c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:50:56.123842 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 519/1011] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:50:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:50:56.131173 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04b62f-c64b-412c-91af-52586e24de81 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:50:56.150708 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04b62f-c64b-412c-91af-52586e24de81 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:50:56.158042 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2851c1-d6b0-49bf-9ef0-c7d57eedb1de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:50:56.158831 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2851c1-d6b0-49bf-9ef0-c7d57eedb1de service nova] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:50:56.159197 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2851c1-d6b0-49bf-9ef0-c7d57eedb1de service nova] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:50:56.159610 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2851c1-d6b0-49bf-9ef0-c7d57eedb1de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:50:56.170879 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2851c1-d6b0-49bf-9ef0-c7d57eedb1de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:50:56.172808 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2851c1-d6b0-49bf-9ef0-c7d57eedb1de service nova] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:50:56.194108 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 493/1012] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:50:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:51:00.434516 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d46049-9796-45dc-a6c4-7bef6aa4bb7a None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:00.436440 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d46049-9796-45dc-a6c4-7bef6aa4bb7a None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:00.436440 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d46049-9796-45dc-a6c4-7bef6aa4bb7a None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:00.437468 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 520/1013] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:51:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:00.443240 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ce951-59d1-43f2-8629-cc3a980b3c9b None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:00.443770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ce951-59d1-43f2-8629-cc3a980b3c9b None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:00.443877 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817ce951-59d1-43f2-8629-cc3a980b3c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:00.462893 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-817ce951-59d1-43f2-8629-cc3a980b3c9b None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:00.471289 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-817ce951-59d1-43f2-8629-cc3a980b3c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:00.472181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 494/1014] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:51:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:00.520736 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d46049-9796-45dc-a6c4-7bef6aa4bb7a None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:00.528291 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=46 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:51:00.535432 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d46049-9796-45dc-a6c4-7bef6aa4bb7a None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:00.540506 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ee5fe-cd73-443d-899b-5726aca9cf03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:00.541155 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ee5fe-cd73-443d-899b-5726aca9cf03 service nova] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:00.541439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ee5fe-cd73-443d-899b-5726aca9cf03 service nova] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:00.541710 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ee5fe-cd73-443d-899b-5726aca9cf03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:00.550713 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ee5fe-cd73-443d-899b-5726aca9cf03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:00.552309 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527ee5fe-cd73-443d-899b-5726aca9cf03 service nova] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:00.562278 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 521/1015] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:51:01.911335 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061ace5-da72-44f4-bc9d-e02894c7f066 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:01.911931 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061ace5-da72-44f4-bc9d-e02894c7f066 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:01.911931 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061ace5-da72-44f4-bc9d-e02894c7f066 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:01.913291 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 495/1016] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:51:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:01.918826 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fee9a4-5a22-49d2-be42-222f27f76754 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:01.919989 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fee9a4-5a22-49d2-be42-222f27f76754 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:01.919989 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fee9a4-5a22-49d2-be42-222f27f76754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:01.938130 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-66fee9a4-5a22-49d2-be42-222f27f76754 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:01.939368 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-66fee9a4-5a22-49d2-be42-222f27f76754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:01.947309 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 522/1017] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:51:01 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:02.007894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a18a30-1821-4495-b4b9-2d2dde77c0fa None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:02.008190 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a18a30-1821-4495-b4b9-2d2dde77c0fa None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:02.008511 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a18a30-1821-4495-b4b9-2d2dde77c0fa None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:02.009891 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 496/1018] 10.222.0.62 () {54 vars in 962 bytes} [Wed May 25 15:51:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:02.016124 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541396b-f145-4882-8527-af70938b1ea9 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:02.016485 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541396b-f145-4882-8527-af70938b1ea9 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:02.016777 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9541396b-f145-4882-8527-af70938b1ea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:02.065600 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-9541396b-f145-4882-8527-af70938b1ea9 None None] MFA Rules not processed for user `530c527ef42e4f949b15c74206baf99b`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:02.066828 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-9541396b-f145-4882-8527-af70938b1ea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:02.135030 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 523/1019] 10.222.0.62 () {58 vars in 1059 bytes} [Wed May 25 15:51:02 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:02.142923 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a18a30-1821-4495-b4b9-2d2dde77c0fa None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:02.155167 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a18a30-1821-4495-b4b9-2d2dde77c0fa None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:02.158771 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d260f0b9-0bbe-4946-833d-eb59f45e3514 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530c527ef42e4f949b15c74206baf99b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:02.159417 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260f0b9-0bbe-4946-833d-eb59f45e3514 service glance] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:02.159755 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260f0b9-0bbe-4946-833d-eb59f45e3514 service glance] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:02.159982 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d260f0b9-0bbe-4946-833d-eb59f45e3514 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:02.170244 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260f0b9-0bbe-4946-833d-eb59f45e3514 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:02.171630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d260f0b9-0bbe-4946-833d-eb59f45e3514 service glance] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:02.175702 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=100 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:51:02.182038 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 497/1020] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:51:03.041121 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5f1b8-105c-4249-874f-10acea9f1e8f None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:03.041689 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5f1b8-105c-4249-874f-10acea9f1e8f None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:03.041689 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd5f1b8-105c-4249-874f-10acea9f1e8f None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:03.043069 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 524/1021] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:51:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:03.049410 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba2c7f-5a17-43c3-9361-8088e27720a0 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:03.049967 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba2c7f-5a17-43c3-9361-8088e27720a0 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:03.049967 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aba2c7f-5a17-43c3-9361-8088e27720a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:03.069742 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-5aba2c7f-5a17-43c3-9361-8088e27720a0 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:03.070994 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-5aba2c7f-5a17-43c3-9361-8088e27720a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:03.080456 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 498/1022] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:51:03 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:03.133408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5f1b8-105c-4249-874f-10acea9f1e8f None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:03.151175 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd5f1b8-105c-4249-874f-10acea9f1e8f None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:03.156500 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c1c8c6-fad6-4163-8150-073ae4f38410 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:03.157442 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1c8c6-fad6-4163-8150-073ae4f38410 service nova] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:03.157855 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1c8c6-fad6-4163-8150-073ae4f38410 service nova] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:03.158302 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c1c8c6-fad6-4163-8150-073ae4f38410 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:03.168441 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1c8c6-fad6-4163-8150-073ae4f38410 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:03.170151 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c1c8c6-fad6-4163-8150-073ae4f38410 service nova] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:03.183154 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 525/1023] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:03 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:51:05.690955 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24da98-12df-4952-89ff-08cf57486b86 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:05.691570 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24da98-12df-4952-89ff-08cf57486b86 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:05.691570 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24da98-12df-4952-89ff-08cf57486b86 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:05.693011 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 499/1024] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:51:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:05.698749 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca18643-1646-408d-b058-3ef73adf2f76 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:05.699344 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca18643-1646-408d-b058-3ef73adf2f76 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:05.699344 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca18643-1646-408d-b058-3ef73adf2f76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:05.719593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-8ca18643-1646-408d-b058-3ef73adf2f76 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:05.723373 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-8ca18643-1646-408d-b058-3ef73adf2f76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:05.731907 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 526/1025] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:51:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:05.781532 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24da98-12df-4952-89ff-08cf57486b86 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:05.796661 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24da98-12df-4952-89ff-08cf57486b86 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:05.801792 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b05f2d-849c-47c7-8cf3-c9b31ec82d75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:05.802450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b05f2d-849c-47c7-8cf3-c9b31ec82d75 service nova] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:05.802738 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b05f2d-849c-47c7-8cf3-c9b31ec82d75 service nova] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:05.806630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b05f2d-849c-47c7-8cf3-c9b31ec82d75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:05.816916 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b05f2d-849c-47c7-8cf3-c9b31ec82d75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:05.818540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b05f2d-849c-47c7-8cf3-c9b31ec82d75 service nova] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:05.829671 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 500/1026] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:51:15.712959 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=55 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:51:15.824318 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=10 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:51:18.618955 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9a813-f602-4094-bf81-b10480d48995 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:18.619575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9a813-f602-4094-bf81-b10480d48995 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:18.619575 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9a813-f602-4094-bf81-b10480d48995 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:18.620956 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 527/1027] 10.222.0.62 () {54 vars in 918 bytes} [Wed May 25 15:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:18.626898 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e4f85-7bf8-4e71-9809-1f497b7773d6 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:18.627439 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e4f85-7bf8-4e71-9809-1f497b7773d6 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:18.627439 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e4f85-7bf8-4e71-9809-1f497b7773d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:18.648869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-f36e4f85-7bf8-4e71-9809-1f497b7773d6 None None] MFA Rules not processed for user `2506613903044131b9e8c75196de862b`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:18.650223 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-f36e4f85-7bf8-4e71-9809-1f497b7773d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:18.659760 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 501/1028] 10.222.0.62 () {58 vars in 1015 bytes} [Wed May 25 15:51:18 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:18.677098 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8ade3-1c73-496c-b2b7-89b67b3e3273 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:18.678313 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8ade3-1c73-496c-b2b7-89b67b3e3273 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:18.678313 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8ade3-1c73-496c-b2b7-89b67b3e3273 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:18.678974 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 528/1029] 10.222.0.62 () {54 vars in 918 bytes} [Wed May 25 15:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:18.684361 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7326b-1180-482e-9c55-31e7a6a5e03a None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:18.684728 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7326b-1180-482e-9c55-31e7a6a5e03a None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:18.685125 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb7326b-1180-482e-9c55-31e7a6a5e03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:18.703760 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-edb7326b-1180-482e-9c55-31e7a6a5e03a None None] MFA Rules not processed for user `d9b8b255e35c4949ba8faeb79921f141`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:18.706893 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-edb7326b-1180-482e-9c55-31e7a6a5e03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:18.713956 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 502/1030] 10.222.0.62 () {58 vars in 1015 bytes} [Wed May 25 15:51:18 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:21.517808 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c553205-eeba-4024-a455-4697a2e0f1cc None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:21.518342 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c553205-eeba-4024-a455-4697a2e0f1cc None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:21.518342 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c553205-eeba-4024-a455-4697a2e0f1cc None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:21.519620 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 529/1031] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:51:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:21.525116 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339ec5c-3c6b-47fe-95ea-01663198c261 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:21.525545 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339ec5c-3c6b-47fe-95ea-01663198c261 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:21.525681 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c339ec5c-3c6b-47fe-95ea-01663198c261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:21.550195 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-c339ec5c-3c6b-47fe-95ea-01663198c261 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:21.550195 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-c339ec5c-3c6b-47fe-95ea-01663198c261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:21.552935 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 503/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:51:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:21.602272 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c553205-eeba-4024-a455-4697a2e0f1cc None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:21.612372 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c553205-eeba-4024-a455-4697a2e0f1cc None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:21.617790 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06fdcd7-60b1-465d-826c-d4fdf3cd8bc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:21.618434 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fdcd7-60b1-465d-826c-d4fdf3cd8bc0 service nova] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:21.618814 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fdcd7-60b1-465d-826c-d4fdf3cd8bc0 service nova] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:21.619097 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06fdcd7-60b1-465d-826c-d4fdf3cd8bc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:21.628324 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06fdcd7-60b1-465d-826c-d4fdf3cd8bc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:21.630002 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06fdcd7-60b1-465d-826c-d4fdf3cd8bc0 service nova] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:21.640343 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 530/1033] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:51:22.656667 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f7817-adaa-4707-ad2f-a6631224d345 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:22.657212 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f7817-adaa-4707-ad2f-a6631224d345 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:22.657212 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f7817-adaa-4707-ad2f-a6631224d345 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:22.658624 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 504/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:22.663763 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f60c28-490d-4795-b368-78823cca11ff None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:22.668379 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f60c28-490d-4795-b368-78823cca11ff None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:22.668379 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f60c28-490d-4795-b368-78823cca11ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:22.684769 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-c6f60c28-490d-4795-b368-78823cca11ff None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:22.686026 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-c6f60c28-490d-4795-b368-78823cca11ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:22.694020 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 531/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:51:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:51:22.911337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f7817-adaa-4707-ad2f-a6631224d345 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:22.924519 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f7817-adaa-4707-ad2f-a6631224d345 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:22.929768 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92508d16-856e-43c7-9afb-992959eef14e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:22.930417 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92508d16-856e-43c7-9afb-992959eef14e service nova] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:22.930774 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92508d16-856e-43c7-9afb-992959eef14e service nova] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:22.931055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92508d16-856e-43c7-9afb-992959eef14e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:22.940723 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92508d16-856e-43c7-9afb-992959eef14e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:22.942356 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92508d16-856e-43c7-9afb-992959eef14e service nova] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:22.953282 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 505/1036] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:51:23.929654 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da11c6-1ad2-4a4b-9728-5d7f2a05b5fe None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:23.930238 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da11c6-1ad2-4a4b-9728-5d7f2a05b5fe None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:23.930238 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89da11c6-1ad2-4a4b-9728-5d7f2a05b5fe None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:23.933988 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 532/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:51:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:23.939607 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293d139-706d-4cc1-b2c7-7e10660079ab None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:23.940162 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293d139-706d-4cc1-b2c7-7e10660079ab None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:23.940162 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1293d139-706d-4cc1-b2c7-7e10660079ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:23.961151 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-1293d139-706d-4cc1-b2c7-7e10660079ab None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:23.962364 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-1293d139-706d-4cc1-b2c7-7e10660079ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:23.970695 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 506/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:51:23 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:24.126965 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da11c6-1ad2-4a4b-9728-5d7f2a05b5fe None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:24.141394 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89da11c6-1ad2-4a4b-9728-5d7f2a05b5fe None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:24.146389 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f913ff0-829d-4857-80b1-b58fc15792aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:24.147645 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f913ff0-829d-4857-80b1-b58fc15792aa service nova] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:24.147645 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f913ff0-829d-4857-80b1-b58fc15792aa service nova] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:24.147645 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f913ff0-829d-4857-80b1-b58fc15792aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:24.157106 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f913ff0-829d-4857-80b1-b58fc15792aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:24.158695 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f913ff0-829d-4857-80b1-b58fc15792aa service nova] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:24.169186 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 533/1039] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:24 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:51:25.098323 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2eb0f-96b7-489c-b322-80e9a11f1515 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:25.098865 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2eb0f-96b7-489c-b322-80e9a11f1515 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:25.098865 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2eb0f-96b7-489c-b322-80e9a11f1515 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:25.100258 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 507/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:25.106044 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cda47a-5ef7-4f1d-a0e9-61d899f17865 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:25.106581 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cda47a-5ef7-4f1d-a0e9-61d899f17865 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:25.106712 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cda47a-5ef7-4f1d-a0e9-61d899f17865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:25.125878 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-71cda47a-5ef7-4f1d-a0e9-61d899f17865 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:25.127092 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-71cda47a-5ef7-4f1d-a0e9-61d899f17865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:25.135310 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 534/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:51:25 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:25.293785 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2eb0f-96b7-489c-b322-80e9a11f1515 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:25.308148 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c2eb0f-96b7-489c-b322-80e9a11f1515 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:25.313625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b0cd5d-f261-45b7-ab7d-7a38bf5e9373 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:25.314346 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0cd5d-f261-45b7-ab7d-7a38bf5e9373 service nova] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:25.314540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0cd5d-f261-45b7-ab7d-7a38bf5e9373 service nova] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:25.314816 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b0cd5d-f261-45b7-ab7d-7a38bf5e9373 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:25.323088 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0cd5d-f261-45b7-ab7d-7a38bf5e9373 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:25.325419 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b0cd5d-f261-45b7-ab7d-7a38bf5e9373 service nova] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:25.335044 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 508/1042] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:25 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:51:26.264281 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4befb6-a263-44b5-8abf-7809eec75cb4 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:26.264912 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4befb6-a263-44b5-8abf-7809eec75cb4 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:26.264912 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4befb6-a263-44b5-8abf-7809eec75cb4 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:26.266264 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 535/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:51:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:26.271139 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448a4cc-312a-4120-b130-37ac9ccd1f2a None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:26.271550 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448a4cc-312a-4120-b130-37ac9ccd1f2a None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:26.271691 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1448a4cc-312a-4120-b130-37ac9ccd1f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:26.291058 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-1448a4cc-312a-4120-b130-37ac9ccd1f2a None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:26.292175 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-1448a4cc-312a-4120-b130-37ac9ccd1f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:26.301030 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 509/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:51:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:26.459779 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4befb6-a263-44b5-8abf-7809eec75cb4 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:26.467392 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4befb6-a263-44b5-8abf-7809eec75cb4 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:26.472516 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a748ee4-e451-4c02-abfa-ffd1fe458a6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:26.473168 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a748ee4-e451-4c02-abfa-ffd1fe458a6b service nova] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:26.473479 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a748ee4-e451-4c02-abfa-ffd1fe458a6b service nova] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:26.473752 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a748ee4-e451-4c02-abfa-ffd1fe458a6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:26.483533 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a748ee4-e451-4c02-abfa-ffd1fe458a6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:26.485271 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a748ee4-e451-4c02-abfa-ffd1fe458a6b service nova] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:26.495399 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 536/1045] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:51:27.441337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a3da8-7025-49db-a5e4-8434b9125bc7 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:27.441854 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a3da8-7025-49db-a5e4-8434b9125bc7 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:27.441854 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243a3da8-7025-49db-a5e4-8434b9125bc7 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:27.443204 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 510/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:27.448233 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f783bbd-806d-4b34-b81b-e3fa93e94ceb None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:27.448699 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f783bbd-806d-4b34-b81b-e3fa93e94ceb None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:27.448891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f783bbd-806d-4b34-b81b-e3fa93e94ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:27.467982 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-3f783bbd-806d-4b34-b81b-e3fa93e94ceb None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:27.469266 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-3f783bbd-806d-4b34-b81b-e3fa93e94ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:27.477251 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 537/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:51:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:27.632512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a3da8-7025-49db-a5e4-8434b9125bc7 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:27.646702 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243a3da8-7025-49db-a5e4-8434b9125bc7 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:27.653383 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f033f74-a7f1-47fd-a338-2dc4853968b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:27.654035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f033f74-a7f1-47fd-a338-2dc4853968b1 service nova] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:27.654315 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f033f74-a7f1-47fd-a338-2dc4853968b1 service nova] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:27.654587 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f033f74-a7f1-47fd-a338-2dc4853968b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:27.663493 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f033f74-a7f1-47fd-a338-2dc4853968b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:27.665143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f033f74-a7f1-47fd-a338-2dc4853968b1 service nova] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:27.675574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 511/1048] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:51:28.630791 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cead65-6d21-46aa-8c07-91ccc33d3e26 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:28.631336 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cead65-6d21-46aa-8c07-91ccc33d3e26 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:28.631336 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cead65-6d21-46aa-8c07-91ccc33d3e26 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:28.632790 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 538/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:51:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:28.638894 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61835db-8914-40d5-9855-f6a58a72750f None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:28.639396 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61835db-8914-40d5-9855-f6a58a72750f None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:28.639396 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61835db-8914-40d5-9855-f6a58a72750f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:28.660273 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-f61835db-8914-40d5-9855-f6a58a72750f None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:28.661513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-f61835db-8914-40d5-9855-f6a58a72750f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:28.669900 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 512/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:51:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:28.822680 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cead65-6d21-46aa-8c07-91ccc33d3e26 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:28.836178 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cead65-6d21-46aa-8c07-91ccc33d3e26 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:28.841743 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5c3bb-b74c-4013-ab6c-4e883c4d0977 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:28.842399 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5c3bb-b74c-4013-ab6c-4e883c4d0977 service nova] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:28.842679 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5c3bb-b74c-4013-ab6c-4e883c4d0977 service nova] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:28.842951 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5c3bb-b74c-4013-ab6c-4e883c4d0977 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:28.851163 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5c3bb-b74c-4013-ab6c-4e883c4d0977 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:28.852772 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5c3bb-b74c-4013-ab6c-4e883c4d0977 service nova] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:28.863456 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 539/1051] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:51:29.782829 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670ad39-3825-49de-8d2d-7c0076c77022 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:29.783375 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670ad39-3825-49de-8d2d-7c0076c77022 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:29.783375 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1670ad39-3825-49de-8d2d-7c0076c77022 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:29.784808 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 513/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:29.791449 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e6af6-7544-425c-904a-6ea84ee7837e None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:29.791856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e6af6-7544-425c-904a-6ea84ee7837e None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:29.791997 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51e6af6-7544-425c-904a-6ea84ee7837e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:29.813883 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-e51e6af6-7544-425c-904a-6ea84ee7837e None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:29.815272 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-e51e6af6-7544-425c-904a-6ea84ee7837e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:29.824461 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 540/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:51:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:29.983668 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670ad39-3825-49de-8d2d-7c0076c77022 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:29.998186 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1670ad39-3825-49de-8d2d-7c0076c77022 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:30.003029 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cc26d-8416-4ae1-9386-3eebaa7d9b67 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:30.003663 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cc26d-8416-4ae1-9386-3eebaa7d9b67 service nova] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:30.003944 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cc26d-8416-4ae1-9386-3eebaa7d9b67 service nova] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:30.004218 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cc26d-8416-4ae1-9386-3eebaa7d9b67 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:30.013304 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cc26d-8416-4ae1-9386-3eebaa7d9b67 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:30.014866 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cc26d-8416-4ae1-9386-3eebaa7d9b67 service nova] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:30.024253 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 514/1054] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:51:31.005066 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b83c99-bb63-4d9b-9c7c-2f2e2c298037 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:31.005641 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b83c99-bb63-4d9b-9c7c-2f2e2c298037 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:31.005641 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b83c99-bb63-4d9b-9c7c-2f2e2c298037 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:31.006973 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 541/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:51:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:31.012746 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59cbf1-faef-455f-8907-8bbbafea074b None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:31.013242 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59cbf1-faef-455f-8907-8bbbafea074b None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:31.013338 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb59cbf1-faef-455f-8907-8bbbafea074b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:31.031328 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-bb59cbf1-faef-455f-8907-8bbbafea074b None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:31.032552 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-bb59cbf1-faef-455f-8907-8bbbafea074b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:31.040337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 515/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:51:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:31.194580 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b83c99-bb63-4d9b-9c7c-2f2e2c298037 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:31.208229 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b83c99-bb63-4d9b-9c7c-2f2e2c298037 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:31.213223 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6286c49e-8064-411d-a8d9-def665d6bc45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:31.213863 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286c49e-8064-411d-a8d9-def665d6bc45 service nova] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:31.214655 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286c49e-8064-411d-a8d9-def665d6bc45 service nova] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:31.214933 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6286c49e-8064-411d-a8d9-def665d6bc45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:31.223316 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286c49e-8064-411d-a8d9-def665d6bc45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:31.224983 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6286c49e-8064-411d-a8d9-def665d6bc45 service nova] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:31.235691 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 542/1057] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:51:33.403090 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f348b8-cdae-4e73-91ae-0166e678db94 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:33.403635 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f348b8-cdae-4e73-91ae-0166e678db94 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:33.403635 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f348b8-cdae-4e73-91ae-0166e678db94 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:33.405341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 516/1058] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:51:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:33.411761 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3b265-0236-418e-a2db-d0aeedac96ff None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:33.416975 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3b265-0236-418e-a2db-d0aeedac96ff None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:33.416975 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3b265-0236-418e-a2db-d0aeedac96ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:33.432378 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-60d3b265-0236-418e-a2db-d0aeedac96ff None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:33.433825 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-60d3b265-0236-418e-a2db-d0aeedac96ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:33.442091 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 543/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:51:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:33.485678 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f348b8-cdae-4e73-91ae-0166e678db94 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:33.496599 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f348b8-cdae-4e73-91ae-0166e678db94 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:33.500008 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145220aa-bff9-411c-8bc9-3646024d5db6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:33.500666 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145220aa-bff9-411c-8bc9-3646024d5db6 service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:33.500949 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145220aa-bff9-411c-8bc9-3646024d5db6 service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:33.501223 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145220aa-bff9-411c-8bc9-3646024d5db6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:33.510309 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145220aa-bff9-411c-8bc9-3646024d5db6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:33.512484 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145220aa-bff9-411c-8bc9-3646024d5db6 service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:33.521902 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 517/1060] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:51:36.182107 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a90e1-6c6b-4826-80b2-911ac031abd1 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:36.182682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a90e1-6c6b-4826-80b2-911ac031abd1 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:36.182682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87a90e1-6c6b-4826-80b2-911ac031abd1 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:36.184063 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 544/1061] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:36.189862 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc3186-16a4-4592-bda4-28cfda2ce436 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:36.190308 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc3186-16a4-4592-bda4-28cfda2ce436 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:36.190430 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bc3186-16a4-4592-bda4-28cfda2ce436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:36.208428 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-c1bc3186-16a4-4592-bda4-28cfda2ce436 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:36.209672 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-c1bc3186-16a4-4592-bda4-28cfda2ce436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:36.218299 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 518/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:51:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:36.259229 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a90e1-6c6b-4826-80b2-911ac031abd1 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:36.270337 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87a90e1-6c6b-4826-80b2-911ac031abd1 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:36.273780 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861bd1f3-fb95-47f8-a200-97c3c05e8f02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:36.274506 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bd1f3-fb95-47f8-a200-97c3c05e8f02 service neutron] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:36.274784 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bd1f3-fb95-47f8-a200-97c3c05e8f02 service neutron] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:36.275055 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861bd1f3-fb95-47f8-a200-97c3c05e8f02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:36.285139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861bd1f3-fb95-47f8-a200-97c3c05e8f02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:36.286583 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861bd1f3-fb95-47f8-a200-97c3c05e8f02 service neutron] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:36.296903 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 545/1063] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:51:39.015928 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a37a26-3e5e-444a-9583-8e72109f667b None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:39.016475 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a37a26-3e5e-444a-9583-8e72109f667b None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:39.016475 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a37a26-3e5e-444a-9583-8e72109f667b None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:39.017854 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 519/1064] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:51:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:39.023337 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455b1cc-a64a-4c83-ac59-802312cb0bb2 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:39.023804 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455b1cc-a64a-4c83-ac59-802312cb0bb2 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:39.023898 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455b1cc-a64a-4c83-ac59-802312cb0bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:39.042371 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-9455b1cc-a64a-4c83-ac59-802312cb0bb2 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:39.043648 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-9455b1cc-a64a-4c83-ac59-802312cb0bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:39.051422 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 546/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:51:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:39.093804 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a37a26-3e5e-444a-9583-8e72109f667b None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:39.105399 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a37a26-3e5e-444a-9583-8e72109f667b None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:39.114172 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61e08e-0500-4054-bf3b-e123c64c6707 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:39.114172 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61e08e-0500-4054-bf3b-e123c64c6707 service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:39.114172 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61e08e-0500-4054-bf3b-e123c64c6707 service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:39.114172 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61e08e-0500-4054-bf3b-e123c64c6707 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:39.124059 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61e08e-0500-4054-bf3b-e123c64c6707 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:39.126586 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61e08e-0500-4054-bf3b-e123c64c6707 service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:39.138887 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 520/1066] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:51:41.578803 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912eadf-003e-4478-b8c1-b546236a0d59 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:41.579352 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912eadf-003e-4478-b8c1-b546236a0d59 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:41.579352 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a912eadf-003e-4478-b8c1-b546236a0d59 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:41.580796 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 547/1067] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:41.586127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8be4d-92d8-4fb8-9ec5-419cf06914b0 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:41.586539 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8be4d-92d8-4fb8-9ec5-419cf06914b0 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:41.586694 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb8be4d-92d8-4fb8-9ec5-419cf06914b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:41.608378 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-6cb8be4d-92d8-4fb8-9ec5-419cf06914b0 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:41.609641 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-6cb8be4d-92d8-4fb8-9ec5-419cf06914b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:41.617871 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 521/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:51:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:41.661028 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912eadf-003e-4478-b8c1-b546236a0d59 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:41.672778 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a912eadf-003e-4478-b8c1-b546236a0d59 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:41.676307 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0229c-399d-428b-b91c-0d9ef4d08412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:41.677061 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0229c-399d-428b-b91c-0d9ef4d08412 service neutron] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:41.677346 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0229c-399d-428b-b91c-0d9ef4d08412 service neutron] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:41.677624 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0229c-399d-428b-b91c-0d9ef4d08412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:41.688067 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0229c-399d-428b-b91c-0d9ef4d08412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:41.689622 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0229c-399d-428b-b91c-0d9ef4d08412 service neutron] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:41.700639 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 548/1069] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:51:44.093239 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0519f8-2b9b-45ab-8cec-fccf5c994b79 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:44.093797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0519f8-2b9b-45ab-8cec-fccf5c994b79 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:44.093797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0519f8-2b9b-45ab-8cec-fccf5c994b79 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:44.095150 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 522/1070] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:51:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:44.100627 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9c65b-5268-4e54-9367-da190b1dee5e None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:44.104561 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9c65b-5268-4e54-9367-da190b1dee5e None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:44.104561 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9c65b-5268-4e54-9367-da190b1dee5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:44.120296 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-aef9c65b-5268-4e54-9367-da190b1dee5e None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:44.127119 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-aef9c65b-5268-4e54-9367-da190b1dee5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:44.129762 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 549/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:51:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:44.169252 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0519f8-2b9b-45ab-8cec-fccf5c994b79 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:44.180640 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0519f8-2b9b-45ab-8cec-fccf5c994b79 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:44.184708 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a28e58-970f-47f4-88b3-4f2ba2bdfae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:44.185357 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a28e58-970f-47f4-88b3-4f2ba2bdfae1 service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:44.185639 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a28e58-970f-47f4-88b3-4f2ba2bdfae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:44.185915 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a28e58-970f-47f4-88b3-4f2ba2bdfae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:44.195608 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a28e58-970f-47f4-88b3-4f2ba2bdfae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:44.197153 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a28e58-970f-47f4-88b3-4f2ba2bdfae1 service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:44.206755 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 523/1072] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:51:46.589948 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeef9a-d15b-4248-a27d-f6203790639b None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:46.590557 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeef9a-d15b-4248-a27d-f6203790639b None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:46.590557 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbeef9a-d15b-4248-a27d-f6203790639b None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:46.591845 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 550/1073] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:51:46.597752 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe60dd8-9c91-4ad4-ab49-b8b436719d00 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:46.598880 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe60dd8-9c91-4ad4-ab49-b8b436719d00 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:46.598880 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe60dd8-9c91-4ad4-ab49-b8b436719d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:46.605801 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=70 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:51:46.618552 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-dbe60dd8-9c91-4ad4-ab49-b8b436719d00 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:46.620580 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-dbe60dd8-9c91-4ad4-ab49-b8b436719d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:46.628382 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 524/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:51:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:46.669131 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbeef9a-d15b-4248-a27d-f6203790639b None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:46.674652 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=64 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:51:46.680450 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbeef9a-d15b-4248-a27d-f6203790639b None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:46.684230 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2cf21-3415-47e1-8ac9-af1607f61204 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:46.684938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2cf21-3415-47e1-8ac9-af1607f61204 service neutron] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:46.685218 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2cf21-3415-47e1-8ac9-af1607f61204 service neutron] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:46.685489 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2cf21-3415-47e1-8ac9-af1607f61204 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:46.694481 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2cf21-3415-47e1-8ac9-af1607f61204 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:46.695997 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2cf21-3415-47e1-8ac9-af1607f61204 service neutron] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:46.705456 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 551/1075] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:51:49.051290 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15866b-7440-41a2-ae21-97165369a4e2 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:49.051875 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15866b-7440-41a2-ae21-97165369a4e2 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:49.051875 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a15866b-7440-41a2-ae21-97165369a4e2 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:49.053278 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 525/1076] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:49.059465 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20f5a9-6b62-4f45-ba8b-feabf8b277a7 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:49.059969 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20f5a9-6b62-4f45-ba8b-feabf8b277a7 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:49.060070 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca20f5a9-6b62-4f45-ba8b-feabf8b277a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:49.078636 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-ca20f5a9-6b62-4f45-ba8b-feabf8b277a7 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:49.079845 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-ca20f5a9-6b62-4f45-ba8b-feabf8b277a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:49.087726 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 552/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:51:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:49.129818 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15866b-7440-41a2-ae21-97165369a4e2 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:49.142155 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a15866b-7440-41a2-ae21-97165369a4e2 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:49.145734 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec83d6a-5cd8-4e36-ace2-70ca640c8b20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:49.146380 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec83d6a-5cd8-4e36-ace2-70ca640c8b20 service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:49.146692 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec83d6a-5cd8-4e36-ace2-70ca640c8b20 service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:49.147084 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec83d6a-5cd8-4e36-ace2-70ca640c8b20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:49.157285 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec83d6a-5cd8-4e36-ace2-70ca640c8b20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:49.158771 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec83d6a-5cd8-4e36-ace2-70ca640c8b20 service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:49.168731 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 526/1078] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:51:51.553518 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42de63-024a-4dd7-896f-0038ebed0577 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:51.558269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42de63-024a-4dd7-896f-0038ebed0577 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:51.558269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42de63-024a-4dd7-896f-0038ebed0577 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:51.558269 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 553/1079] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:51.561212 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3ca1b-bf85-441d-b4a3-0acf591e8d0b None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:51.561612 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3ca1b-bf85-441d-b4a3-0acf591e8d0b None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:51.561778 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f3ca1b-bf85-441d-b4a3-0acf591e8d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:51.579482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-60f3ca1b-bf85-441d-b4a3-0acf591e8d0b None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:51.580756 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-60f3ca1b-bf85-441d-b4a3-0acf591e8d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:51.588389 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 527/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:51:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:51.628613 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42de63-024a-4dd7-896f-0038ebed0577 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:51.639980 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c42de63-024a-4dd7-896f-0038ebed0577 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:51.643519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba23f9-9ed4-4517-8a1d-8bbee36bc6ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:51.644220 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba23f9-9ed4-4517-8a1d-8bbee36bc6ae service neutron] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:51.644548 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba23f9-9ed4-4517-8a1d-8bbee36bc6ae service neutron] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:51.649967 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba23f9-9ed4-4517-8a1d-8bbee36bc6ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:51.654601 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba23f9-9ed4-4517-8a1d-8bbee36bc6ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:51.656116 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba23f9-9ed4-4517-8a1d-8bbee36bc6ae service neutron] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:51.665734 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 554/1081] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:51:53.976139 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2233d49-9bc6-420b-b3c8-cd554b88533b None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:53.976735 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2233d49-9bc6-420b-b3c8-cd554b88533b None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:53.976735 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2233d49-9bc6-420b-b3c8-cd554b88533b None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:53.978112 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 528/1082] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:53.983625 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be927b5-9b94-4351-bd18-a4f31e0a9550 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:53.984112 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be927b5-9b94-4351-bd18-a4f31e0a9550 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:53.984220 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be927b5-9b94-4351-bd18-a4f31e0a9550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:54.002651 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-3be927b5-9b94-4351-bd18-a4f31e0a9550 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:54.003870 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-3be927b5-9b94-4351-bd18-a4f31e0a9550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:54.012496 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 555/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:51:53 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:54.051288 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2233d49-9bc6-420b-b3c8-cd554b88533b None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:54.062409 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2233d49-9bc6-420b-b3c8-cd554b88533b None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:54.065880 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fb95cc-811b-4d61-856f-07212c75fc00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:54.066513 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb95cc-811b-4d61-856f-07212c75fc00 service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:54.066802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb95cc-811b-4d61-856f-07212c75fc00 service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:54.067079 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fb95cc-811b-4d61-856f-07212c75fc00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:54.076795 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb95cc-811b-4d61-856f-07212c75fc00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:54.078279 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fb95cc-811b-4d61-856f-07212c75fc00 service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:54.088280 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 529/1084] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:51:56.404916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bd134-916c-46e0-b82d-013c5ed0f229 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:56.405430 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bd134-916c-46e0-b82d-013c5ed0f229 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:56.405430 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07bd134-916c-46e0-b82d-013c5ed0f229 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:56.406784 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 556/1085] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:51:56.414763 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753defdf-05cb-4f02-af86-dc586a8269f1 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:56.415237 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753defdf-05cb-4f02-af86-dc586a8269f1 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:56.415351 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753defdf-05cb-4f02-af86-dc586a8269f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:56.433025 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-753defdf-05cb-4f02-af86-dc586a8269f1 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:51:56.434228 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-753defdf-05cb-4f02-af86-dc586a8269f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:51:56.442129 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 530/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:51:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:51:56.480469 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bd134-916c-46e0-b82d-013c5ed0f229 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:51:56.491799 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07bd134-916c-46e0-b82d-013c5ed0f229 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:51:56.495995 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0548b5b-6be7-442b-811a-e86ec4f69acf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:51:56.496670 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0548b5b-6be7-442b-811a-e86ec4f69acf service neutron] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:51:56.496947 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0548b5b-6be7-442b-811a-e86ec4f69acf service neutron] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:51:56.497227 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0548b5b-6be7-442b-811a-e86ec4f69acf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:51:56.506632 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0548b5b-6be7-442b-811a-e86ec4f69acf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:51:56.508069 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0548b5b-6be7-442b-811a-e86ec4f69acf service neutron] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:51:56.518472 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 557/1087] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:51:56 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:52:06.427688 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=20 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:52:06.514078 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=23 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:52:31.452246 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd8188-59b9-4d1d-bed7-6aa4d75b075f None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:31.452869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd8188-59b9-4d1d-bed7-6aa4d75b075f None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:31.452869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafd8188-59b9-4d1d-bed7-6aa4d75b075f None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:31.454150 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 531/1088] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:52:31.459328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1453b4-5e6f-446c-a142-f340b1a1ab90 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:31.459790 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1453b4-5e6f-446c-a142-f340b1a1ab90 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:31.459929 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1453b4-5e6f-446c-a142-f340b1a1ab90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:31.479020 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-fe1453b4-5e6f-446c-a142-f340b1a1ab90 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:52:31.480268 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-fe1453b4-5e6f-446c-a142-f340b1a1ab90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:52:31.488398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 558/1089] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:52:31 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:52:31.537537 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0c88d-b4b5-483c-a0a1-3187fe58c33b None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:31.537835 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0c88d-b4b5-483c-a0a1-3187fe58c33b None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:31.538120 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc0c88d-b4b5-483c-a0a1-3187fe58c33b None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:31.539930 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 532/1090] 10.222.0.62 () {54 vars in 962 bytes} [Wed May 25 15:52:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:52:31.545411 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3dd86-7dcd-4e7d-9946-3f5adf6d3366 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:31.545704 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3dd86-7dcd-4e7d-9946-3f5adf6d3366 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:31.545987 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f3dd86-7dcd-4e7d-9946-3f5adf6d3366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:31.563856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-e9f3dd86-7dcd-4e7d-9946-3f5adf6d3366 None None] MFA Rules not processed for user `530c527ef42e4f949b15c74206baf99b`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:52:31.565089 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-e9f3dd86-7dcd-4e7d-9946-3f5adf6d3366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:52:31.572011 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 559/1091] 10.222.0.62 () {58 vars in 1059 bytes} [Wed May 25 15:52:31 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:52:31.579319 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0c88d-b4b5-483c-a0a1-3187fe58c33b None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:52:31.590589 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc0c88d-b4b5-483c-a0a1-3187fe58c33b None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:52:31.594074 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1963a74-ea00-42f0-9436-b4d990dc65fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530c527ef42e4f949b15c74206baf99b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:52:31.594715 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1963a74-ea00-42f0-9436-b4d990dc65fc service glance] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:31.595002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1963a74-ea00-42f0-9436-b4d990dc65fc service glance] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:31.595281 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1963a74-ea00-42f0-9436-b4d990dc65fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:31.604556 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1963a74-ea00-42f0-9436-b4d990dc65fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:52:31.605991 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1963a74-ea00-42f0-9436-b4d990dc65fc service glance] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:52:31.615804 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 533/1092] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:52:31 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:52:34.053422 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7f908-8904-4b44-b797-fdb9cb442b4e None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:34.054065 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7f908-8904-4b44-b797-fdb9cb442b4e None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:34.054065 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f7f908-8904-4b44-b797-fdb9cb442b4e None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:34.055456 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 560/1093] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:52:34.061065 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6298a5-1c4c-49c9-9f38-7ed8570e7a41 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:34.067023 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6298a5-1c4c-49c9-9f38-7ed8570e7a41 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:34.067023 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6298a5-1c4c-49c9-9f38-7ed8570e7a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:34.079419 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-5a6298a5-1c4c-49c9-9f38-7ed8570e7a41 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:52:34.080707 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-5a6298a5-1c4c-49c9-9f38-7ed8570e7a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:52:34.089259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 534/1094] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:52:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:52:34.115361 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7f908-8904-4b44-b797-fdb9cb442b4e None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:52:34.128247 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f7f908-8904-4b44-b797-fdb9cb442b4e None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:52:34.133375 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae89eba-0911-466a-a68d-45e0aec139ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:52:34.134067 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae89eba-0911-466a-a68d-45e0aec139ec admin admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:34.134779 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae89eba-0911-466a-a68d-45e0aec139ec admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:34.134779 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae89eba-0911-466a-a68d-45e0aec139ec admin admin] PATH_INFO: `/v3/projects` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:34.135342 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae89eba-0911-466a-a68d-45e0aec139ec admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:52:34.137155 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: WARNING py.warnings [None req-fae89eba-0911-466a-a68d-45e0aec139ec admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:52:34.137155 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: warnings.warn(msg) May 25 15:52:34.137155 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: May 25 15:52:34.138316 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae89eba-0911-466a-a68d-45e0aec139ec admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:52:34.158339 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 561/1095] 10.222.0.62 () {56 vars in 1108 bytes} [Wed May 25 15:52:34 2022] GET /identity/v3/projects => generated 1606 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:52:36.499797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca30b16-d32f-485c-872f-38557dfaeeba None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:36.500362 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca30b16-d32f-485c-872f-38557dfaeeba None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:36.500362 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca30b16-d32f-485c-872f-38557dfaeeba None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:36.501737 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 535/1096] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:52:36.507867 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b5b48-4f6f-4a5c-901f-efa5128da2a6 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:36.508336 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b5b48-4f6f-4a5c-901f-efa5128da2a6 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:36.508487 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46b5b48-4f6f-4a5c-901f-efa5128da2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:36.527335 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-f46b5b48-4f6f-4a5c-901f-efa5128da2a6 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:52:36.528604 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-f46b5b48-4f6f-4a5c-901f-efa5128da2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:52:36.536528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 562/1097] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:52:36 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:52:36.581689 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca30b16-d32f-485c-872f-38557dfaeeba None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:52:36.595926 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca30b16-d32f-485c-872f-38557dfaeeba None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:52:36.601035 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d4275b-a6ae-4ef2-a368-ba6e6a5f5730 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:52:36.601616 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4275b-a6ae-4ef2-a368-ba6e6a5f5730 service nova] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:36.601903 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4275b-a6ae-4ef2-a368-ba6e6a5f5730 service nova] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:36.602184 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4275b-a6ae-4ef2-a368-ba6e6a5f5730 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:36.610769 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4275b-a6ae-4ef2-a368-ba6e6a5f5730 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:52:36.612340 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d4275b-a6ae-4ef2-a368-ba6e6a5f5730 service nova] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:52:36.621952 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 536/1098] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:52:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:52:39.105103 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc613f-130c-4953-bf68-dd8af7592646 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:39.105738 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc613f-130c-4953-bf68-dd8af7592646 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:39.105738 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc613f-130c-4953-bf68-dd8af7592646 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:39.107139 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 563/1099] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:52:39.113046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37b293-ad1a-4531-8727-8e33e8426f2b None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:39.113501 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37b293-ad1a-4531-8727-8e33e8426f2b None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:39.113835 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e37b293-ad1a-4531-8727-8e33e8426f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:39.134450 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-6e37b293-ad1a-4531-8727-8e33e8426f2b None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:52:39.135981 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-6e37b293-ad1a-4531-8727-8e33e8426f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:52:39.143748 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 537/1100] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:52:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:52:39.183344 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc613f-130c-4953-bf68-dd8af7592646 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:52:39.194856 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc613f-130c-4953-bf68-dd8af7592646 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:52:39.198454 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f8ad98-397b-4b3b-974e-2f03ff0c4c8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:52:39.199089 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8ad98-397b-4b3b-974e-2f03ff0c4c8d service neutron] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:39.199370 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8ad98-397b-4b3b-974e-2f03ff0c4c8d service neutron] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:39.199646 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f8ad98-397b-4b3b-974e-2f03ff0c4c8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:39.208741 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8ad98-397b-4b3b-974e-2f03ff0c4c8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:52:39.210429 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f8ad98-397b-4b3b-974e-2f03ff0c4c8d service neutron] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:52:39.219795 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 564/1101] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:52:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:52:41.568867 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498fef1-41ef-4ff0-9d9f-4e65cd4a99f6 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:41.569544 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498fef1-41ef-4ff0-9d9f-4e65cd4a99f6 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:41.569651 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1498fef1-41ef-4ff0-9d9f-4e65cd4a99f6 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:41.571273 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 538/1102] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:52:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:52:41.577051 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487e844-eb1c-497e-8e9a-5c359cfcd1cf None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:41.577505 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487e844-eb1c-497e-8e9a-5c359cfcd1cf None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:41.577622 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7487e844-eb1c-497e-8e9a-5c359cfcd1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:41.595777 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-7487e844-eb1c-497e-8e9a-5c359cfcd1cf None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:52:41.597034 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-7487e844-eb1c-497e-8e9a-5c359cfcd1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:52:41.606645 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 565/1103] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:52:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:52:41.647781 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498fef1-41ef-4ff0-9d9f-4e65cd4a99f6 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:52:41.658662 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1498fef1-41ef-4ff0-9d9f-4e65cd4a99f6 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:52:41.662566 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcae99-c078-4ab8-b407-d4be73a0f06c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:52:41.663858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcae99-c078-4ab8-b407-d4be73a0f06c service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:41.664145 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcae99-c078-4ab8-b407-d4be73a0f06c service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:41.664462 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcae99-c078-4ab8-b407-d4be73a0f06c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:41.674408 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcae99-c078-4ab8-b407-d4be73a0f06c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:52:41.677155 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcae99-c078-4ab8-b407-d4be73a0f06c service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:52:41.685538 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 539/1104] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:52:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:52:44.144520 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b263e-efcf-4323-87ff-af85cf2c1291 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:44.145116 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b263e-efcf-4323-87ff-af85cf2c1291 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:44.145116 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107b263e-efcf-4323-87ff-af85cf2c1291 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:44.146416 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 566/1105] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:52:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:52:44.151848 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d86b3a-7d4a-4c10-8e4a-580c73eff201 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:44.152273 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d86b3a-7d4a-4c10-8e4a-580c73eff201 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:44.152444 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d86b3a-7d4a-4c10-8e4a-580c73eff201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:44.170572 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-01d86b3a-7d4a-4c10-8e4a-580c73eff201 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:52:44.171779 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-01d86b3a-7d4a-4c10-8e4a-580c73eff201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:52:44.180916 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 540/1106] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:52:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:52:44.221891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b263e-efcf-4323-87ff-af85cf2c1291 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:52:44.233501 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107b263e-efcf-4323-87ff-af85cf2c1291 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:52:44.236935 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485481cc-e1c2-4309-8aae-6d9bbf3fdfb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:52:44.237573 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485481cc-e1c2-4309-8aae-6d9bbf3fdfb9 service neutron] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:44.237859 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485481cc-e1c2-4309-8aae-6d9bbf3fdfb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:44.238133 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485481cc-e1c2-4309-8aae-6d9bbf3fdfb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:44.248458 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485481cc-e1c2-4309-8aae-6d9bbf3fdfb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:52:44.249934 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485481cc-e1c2-4309-8aae-6d9bbf3fdfb9 service neutron] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:52:44.260092 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 567/1107] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:52:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:52:47.036151 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49c5e7-ad95-454b-8a20-800ba9266b24 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:47.036754 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49c5e7-ad95-454b-8a20-800ba9266b24 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:47.036754 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49c5e7-ad95-454b-8a20-800ba9266b24 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:47.038758 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 541/1108] 10.222.0.62 () {54 vars in 926 bytes} [Wed May 25 15:52:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:52:47.044148 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50c527-a07f-4738-895a-c33fa0ff08ba None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:47.044607 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50c527-a07f-4738-895a-c33fa0ff08ba None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:47.044745 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50c527-a07f-4738-895a-c33fa0ff08ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:47.063184 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-6a50c527-a07f-4738-895a-c33fa0ff08ba None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:52:47.064394 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-6a50c527-a07f-4738-895a-c33fa0ff08ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:52:47.073199 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 568/1109] 10.222.0.62 () {58 vars in 1023 bytes} [Wed May 25 15:52:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:52:47.114641 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49c5e7-ad95-454b-8a20-800ba9266b24 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:52:47.126070 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49c5e7-ad95-454b-8a20-800ba9266b24 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:52:47.129527 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dacefa4-cd6c-4c35-8b17-3812e72b0aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:52:47.130165 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacefa4-cd6c-4c35-8b17-3812e72b0aca service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:52:47.130451 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacefa4-cd6c-4c35-8b17-3812e72b0aca service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:52:47.130763 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dacefa4-cd6c-4c35-8b17-3812e72b0aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:52:47.140097 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacefa4-cd6c-4c35-8b17-3812e72b0aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:52:47.141576 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dacefa4-cd6c-4c35-8b17-3812e72b0aca service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:52:47.150940 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 542/1110] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:52:47 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:52:57.057759 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=33 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:52:57.146783 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=33 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:54:45.426024 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f66242-c79a-48a7-af0d-4ec18e91ab34 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:54:45.426675 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f66242-c79a-48a7-af0d-4ec18e91ab34 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:54:45.426675 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f66242-c79a-48a7-af0d-4ec18e91ab34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:54:45.445119 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-a5f66242-c79a-48a7-af0d-4ec18e91ab34 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:54:45.446333 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-a5f66242-c79a-48a7-af0d-4ec18e91ab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:54:45.454433 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 569/1111] 10.222.0.62 () {58 vars in 957 bytes} [Wed May 25 15:54:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:54:45.463799 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579cd19-b767-4d00-b838-fb22852e408d None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:54:45.469734 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579cd19-b767-4d00-b838-fb22852e408d None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:54:45.469734 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579cd19-b767-4d00-b838-fb22852e408d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:54:45.488065 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-f579cd19-b767-4d00-b838-fb22852e408d None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:54:45.490360 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-f579cd19-b767-4d00-b838-fb22852e408d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:54:45.501832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 543/1112] 10.222.0.62 () {58 vars in 957 bytes} [Wed May 25 15:54:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:54:45.506863 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f66242-c79a-48a7-af0d-4ec18e91ab34 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:54:45.517369 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f66242-c79a-48a7-af0d-4ec18e91ab34 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:54:45.524110 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17f8b1-2365-4bbe-815b-8a55db7b9f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:54:45.524831 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17f8b1-2365-4bbe-815b-8a55db7b9f4d admin admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:54:45.525123 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17f8b1-2365-4bbe-815b-8a55db7b9f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:54:45.525402 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17f8b1-2365-4bbe-815b-8a55db7b9f4d admin admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:54:45.526122 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17f8b1-2365-4bbe-815b-8a55db7b9f4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:54:45.526427 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17f8b1-2365-4bbe-815b-8a55db7b9f4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:54:45.527451 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: WARNING py.warnings [None req-dc17f8b1-2365-4bbe-815b-8a55db7b9f4d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:54:45.527451 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: warnings.warn(msg) May 25 15:54:45.527451 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: May 25 15:54:45.528468 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17f8b1-2365-4bbe-815b-8a55db7b9f4d admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:54:45.541397 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 570/1113] 10.222.0.62 () {58 vars in 1152 bytes} [Wed May 25 15:54:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:54:45.549533 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579cd19-b767-4d00-b838-fb22852e408d None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:54:45.559712 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579cd19-b767-4d00-b838-fb22852e408d None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:54:45.566354 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb632729-2a1a-4e67-8303-ecc9b1e61b76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:54:45.567016 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb632729-2a1a-4e67-8303-ecc9b1e61b76 admin admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:54:45.567303 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb632729-2a1a-4e67-8303-ecc9b1e61b76 admin admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:54:45.567582 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb632729-2a1a-4e67-8303-ecc9b1e61b76 admin admin] PATH_INFO: `/v3/projects` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:54:45.568277 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb632729-2a1a-4e67-8303-ecc9b1e61b76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:54:45.570424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: WARNING py.warnings [None req-eb632729-2a1a-4e67-8303-ecc9b1e61b76 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:54:45.570424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: warnings.warn(msg) May 25 15:54:45.570424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: May 25 15:54:45.571331 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb632729-2a1a-4e67-8303-ecc9b1e61b76 admin admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:54:45.729301 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 544/1114] 10.222.0.62 () {60 vars in 1152 bytes} [Wed May 25 15:54:45 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:54:45.733538 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17f8b1-2365-4bbe-815b-8a55db7b9f4d admin admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:54:45.744582 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17f8b1-2365-4bbe-815b-8a55db7b9f4d admin admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:54:45.803351 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd745a18-20ff-49bb-bb92-56fdf136b028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:54:45.804034 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd745a18-20ff-49bb-bb92-56fdf136b028 admin admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:54:45.804320 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd745a18-20ff-49bb-bb92-56fdf136b028 admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:54:45.804632 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd745a18-20ff-49bb-bb92-56fdf136b028 admin admin] PATH_INFO: `/v3/users` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:54:45.805336 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd745a18-20ff-49bb-bb92-56fdf136b028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:54:45.806361 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: WARNING py.warnings [None req-cd745a18-20ff-49bb-bb92-56fdf136b028 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:54:45.806361 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: warnings.warn(msg) May 25 15:54:45.806361 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: May 25 15:54:45.807563 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd745a18-20ff-49bb-bb92-56fdf136b028 admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:54:45.925744 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 571/1115] 10.222.0.62 () {60 vars in 1143 bytes} [Wed May 25 15:54:45 2022] POST /identity/v3/users => generated 288 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:54:45.929881 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb632729-2a1a-4e67-8303-ecc9b1e61b76 admin admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:54:45.941427 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb632729-2a1a-4e67-8303-ecc9b1e61b76 admin admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:54:45.946236 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1551e35-d94c-4dfc-9c48-7398420443f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:54:45.946932 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1551e35-d94c-4dfc-9c48-7398420443f0 admin admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:54:45.947219 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1551e35-d94c-4dfc-9c48-7398420443f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:54:45.947500 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1551e35-d94c-4dfc-9c48-7398420443f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:54:45.948234 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1551e35-d94c-4dfc-9c48-7398420443f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:54:45.949338 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: WARNING py.warnings [None req-a1551e35-d94c-4dfc-9c48-7398420443f0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:54:45.949338 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: warnings.warn(msg) May 25 15:54:45.949338 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: May 25 15:54:45.953359 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1551e35-d94c-4dfc-9c48-7398420443f0 admin admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:54:45.965319 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 545/1116] 10.222.0.62 () {58 vars in 1121 bytes} [Wed May 25 15:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:54:45.969634 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd745a18-20ff-49bb-bb92-56fdf136b028 admin admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:54:45.981144 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd745a18-20ff-49bb-bb92-56fdf136b028 admin admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:54:45.985664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220a07a-5f44-47c1-ac0f-dd431fff8a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:54:45.986333 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220a07a-5f44-47c1-ac0f-dd431fff8a88 admin admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:54:45.986617 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220a07a-5f44-47c1-ac0f-dd431fff8a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:54:45.986894 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220a07a-5f44-47c1-ac0f-dd431fff8a88 admin admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:54:45.987876 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220a07a-5f44-47c1-ac0f-dd431fff8a88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:54:45.989155 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: WARNING py.warnings [None req-a220a07a-5f44-47c1-ac0f-dd431fff8a88 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:54:45.989155 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: warnings.warn(msg) May 25 15:54:45.989155 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: May 25 15:54:45.990046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a220a07a-5f44-47c1-ac0f-dd431fff8a88 admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:54:46.003986 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 572/1117] 10.222.0.62 () {58 vars in 1121 bytes} [Wed May 25 15:54:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:54:46.008153 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1551e35-d94c-4dfc-9c48-7398420443f0 admin admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:54:46.019326 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1551e35-d94c-4dfc-9c48-7398420443f0 admin admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:54:46.023944 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff97820d-f14f-4e2a-9ca7-4d5f09875806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:54:46.024858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97820d-f14f-4e2a-9ca7-4d5f09875806 admin admin] REQUEST_METHOD: `PUT` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:54:46.025142 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97820d-f14f-4e2a-9ca7-4d5f09875806 admin admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:54:46.025418 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff97820d-f14f-4e2a-9ca7-4d5f09875806 admin admin] PATH_INFO: `/v3/projects/52ef3b0d036446c09c972724732064fe/users/2fe675d6332b400790908d0e14ed842b/roles/5614294f6ab949a99424ee6e983b6430` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:54:46.040933 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97820d-f14f-4e2a-9ca7-4d5f09875806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52ef3b0d036446c09c972724732064fe, user_id=2fe675d6332b400790908d0e14ed842b, role_id=5614294f6ab949a99424ee6e983b6430)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:54:46.041969 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: WARNING py.warnings [None req-ff97820d-f14f-4e2a-9ca7-4d5f09875806 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:54:46.041969 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: warnings.warn(msg) May 25 15:54:46.041969 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: May 25 15:54:46.043848 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff97820d-f14f-4e2a-9ca7-4d5f09875806 admin admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:54:46.125512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 546/1118] 10.222.0.62 () {60 vars in 1482 bytes} [Wed May 25 15:54:46 2022] PUT /identity/v3/projects/52ef3b0d036446c09c972724732064fe/users/2fe675d6332b400790908d0e14ed842b/roles/5614294f6ab949a99424ee6e983b6430 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:54:46.137241 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef569a-c770-4972-8772-84beca0b0291 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:54:46.137531 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef569a-c770-4972-8772-84beca0b0291 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:54:46.137808 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef569a-c770-4972-8772-84beca0b0291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:54:46.166134 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-d0ef569a-c770-4972-8772-84beca0b0291 None None] MFA Rules not processed for user `2fe675d6332b400790908d0e14ed842b`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:54:46.167350 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-d0ef569a-c770-4972-8772-84beca0b0291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:54:46.232941 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 573/1119] 10.222.0.62 () {58 vars in 957 bytes} [Wed May 25 15:54:46 2022] POST /identity/v3/auth/tokens => generated 2802 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:54:46.245818 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9cd82-3cbd-4882-ab59-ec0c7fd3bf3e None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:54:46.246118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9cd82-3cbd-4882-ab59-ec0c7fd3bf3e None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:54:46.246406 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd9cd82-3cbd-4882-ab59-ec0c7fd3bf3e None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:54:46.247799 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 547/1120] 10.222.0.62 () {54 vars in 963 bytes} [Wed May 25 15:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:54:46.254223 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86406b0-845c-4554-9073-faaf251e3d8d None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:54:46.254223 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86406b0-845c-4554-9073-faaf251e3d8d None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:54:46.254521 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86406b0-845c-4554-9073-faaf251e3d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:54:46.273834 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-e86406b0-845c-4554-9073-faaf251e3d8d None None] MFA Rules not processed for user `45fabc3594f64571a0b381990b7974f8`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:54:46.275058 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-e86406b0-845c-4554-9073-faaf251e3d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:54:46.320398 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:54:46.328055 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 574/1121] 10.222.0.62 () {58 vars in 1060 bytes} [Wed May 25 15:54:46 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:54:46.336932 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9cd82-3cbd-4882-ab59-ec0c7fd3bf3e None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:54:46.350368 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd9cd82-3cbd-4882-ab59-ec0c7fd3bf3e None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:54:46.354363 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff59b5f-2163-4c64-8f29-a052050ac7f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45fabc3594f64571a0b381990b7974f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:54:46.355040 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff59b5f-2163-4c64-8f29-a052050ac7f9 service cinder] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:54:46.355327 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff59b5f-2163-4c64-8f29-a052050ac7f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:54:46.355604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff59b5f-2163-4c64-8f29-a052050ac7f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:54:46.364771 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff59b5f-2163-4c64-8f29-a052050ac7f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:54:46.366220 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff59b5f-2163-4c64-8f29-a052050ac7f9 service cinder] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:54:46.379255 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 548/1122] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:54:46 2022] GET /identity/v3/auth/tokens => generated 2802 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:54:46.415871 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9baaf-e0d7-426b-b919-1a474c835122 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:54:46.416159 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9baaf-e0d7-426b-b919-1a474c835122 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:54:46.416541 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f9baaf-e0d7-426b-b919-1a474c835122 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:54:46.417741 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 575/1123] 10.222.0.62 () {52 vars in 829 bytes} [Wed May 25 15:54:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:54:46.421265 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff59b5f-2163-4c64-8f29-a052050ac7f9 service cinder] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:54:46.493613 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff59b5f-2163-4c64-8f29-a052050ac7f9 service cinder] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:54:46.498051 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba782cf5-a483-49da-aa5f-821dff1e2461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:54:46.499323 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba782cf5-a483-49da-aa5f-821dff1e2461 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:54:46.499685 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba782cf5-a483-49da-aa5f-821dff1e2461 admin admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:54:46.499964 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba782cf5-a483-49da-aa5f-821dff1e2461 admin admin] PATH_INFO: `/v3/users/2fe675d6332b400790908d0e14ed842b` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:54:46.501374 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba782cf5-a483-49da-aa5f-821dff1e2461 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fe675d6332b400790908d0e14ed842b)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:54:46.502425 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: WARNING py.warnings [None req-ba782cf5-a483-49da-aa5f-821dff1e2461 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:54:46.502425 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: warnings.warn(msg) May 25 15:54:46.502425 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: May 25 15:54:46.504575 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba782cf5-a483-49da-aa5f-821dff1e2461 admin admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:54:46.733929 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-ba782cf5-a483-49da-aa5f-821dff1e2461 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fe675d6332b400790908d0e14ed842b'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:54:46.734660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-ba782cf5-a483-49da-aa5f-821dff1e2461 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fe675d6332b400790908d0e14ed842b'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:54:46.749382 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-ba782cf5-a483-49da-aa5f-821dff1e2461 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fe675d6332b400790908d0e14ed842b'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:54:46.767060 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-ba782cf5-a483-49da-aa5f-821dff1e2461 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fe675d6332b400790908d0e14ed842b'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:54:46.767809 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-ba782cf5-a483-49da-aa5f-821dff1e2461 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fe675d6332b400790908d0e14ed842b'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:54:46.772442 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:54:46.847090 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 549/1124] 10.222.0.62 () {58 vars in 1223 bytes} [Wed May 25 15:54:46 2022] DELETE /identity/v3/users/2fe675d6332b400790908d0e14ed842b => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:54:46.851910 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22376a4-3554-4380-afd9-3fc8808eaf23 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:54:46.852383 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22376a4-3554-4380-afd9-3fc8808eaf23 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:54:46.852521 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22376a4-3554-4380-afd9-3fc8808eaf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:54:46.872328 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-b22376a4-3554-4380-afd9-3fc8808eaf23 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:54:46.873602 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-b22376a4-3554-4380-afd9-3fc8808eaf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:54:46.936948 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 576/1125] 10.222.0.62 () {58 vars in 957 bytes} [Wed May 25 15:54:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:54:46.946670 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba782cf5-a483-49da-aa5f-821dff1e2461 admin admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:54:46.948113 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-ba782cf5-a483-49da-aa5f-821dff1e2461 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:54:47.013670 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba782cf5-a483-49da-aa5f-821dff1e2461 admin admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:54:47.017280 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456d4c23-2218-4aff-9ca3-480c0b950439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:54:47.017930 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d4c23-2218-4aff-9ca3-480c0b950439 service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:54:47.018213 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d4c23-2218-4aff-9ca3-480c0b950439 service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:54:47.018503 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d4c23-2218-4aff-9ca3-480c0b950439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:54:47.028055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d4c23-2218-4aff-9ca3-480c0b950439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:54:47.029527 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456d4c23-2218-4aff-9ca3-480c0b950439 service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:54:47.039397 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 550/1126] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:54:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:54:47.511537 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22376a4-3554-4380-afd9-3fc8808eaf23 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:54:47.513088 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-b22376a4-3554-4380-afd9-3fc8808eaf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:54:47.525672 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22376a4-3554-4380-afd9-3fc8808eaf23 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:54:47.530579 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156ab79-88ca-4f6d-9b2a-d6dc7cbd833d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:54:47.531448 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156ab79-88ca-4f6d-9b2a-d6dc7cbd833d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:54:47.531736 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156ab79-88ca-4f6d-9b2a-d6dc7cbd833d admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:54:47.532014 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156ab79-88ca-4f6d-9b2a-d6dc7cbd833d admin admin] PATH_INFO: `/v3/projects/52ef3b0d036446c09c972724732064fe` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:54:47.533402 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156ab79-88ca-4f6d-9b2a-d6dc7cbd833d admin admin] RBAC: Authorizing `identity:delete_project(project_id=52ef3b0d036446c09c972724732064fe)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:54:47.535593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: WARNING py.warnings [None req-0156ab79-88ca-4f6d-9b2a-d6dc7cbd833d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:54:47.535593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: warnings.warn(msg) May 25 15:54:47.535593 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: May 25 15:54:47.536849 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156ab79-88ca-4f6d-9b2a-d6dc7cbd833d admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:54:47.665755 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-0156ab79-88ca-4f6d-9b2a-d6dc7cbd833d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52ef3b0d036446c09c972724732064fe', 'request_id': 'req-0156ab79-88ca-4f6d-9b2a-d6dc7cbd833d'} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:54:47.672081 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-0156ab79-88ca-4f6d-9b2a-d6dc7cbd833d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52ef3b0d036446c09c972724732064fe', 'request_id': 'req-0156ab79-88ca-4f6d-9b2a-d6dc7cbd833d'} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:54:47.685971 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-0156ab79-88ca-4f6d-9b2a-d6dc7cbd833d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52ef3b0d036446c09c972724732064fe', 'request_id': 'req-0156ab79-88ca-4f6d-9b2a-d6dc7cbd833d'} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:54:47.807524 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-0156ab79-88ca-4f6d-9b2a-d6dc7cbd833d admin admin] The token cache is being invalidate because project 52ef3b0d036446c09c972724732064fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 15:54:47.807817 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-0156ab79-88ca-4f6d-9b2a-d6dc7cbd833d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:54:47.811439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-0156ab79-88ca-4f6d-9b2a-d6dc7cbd833d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 15:54:47.811439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 577/1127] 10.222.0.62 () {58 vars in 1232 bytes} [Wed May 25 15:54:47 2022] DELETE /identity/v3/projects/52ef3b0d036446c09c972724732064fe => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:54:57.035291 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:54:57.803576 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:56:14.747514 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bc0c9-90c2-49ec-8a85-62394920a079 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:14.748121 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bc0c9-90c2-49ec-8a85-62394920a079 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:14.748121 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944bc0c9-90c2-49ec-8a85-62394920a079 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:14.749480 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 551/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:56:14.754301 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ae9bd-3d55-4307-bf40-0141456ccf89 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:14.754706 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ae9bd-3d55-4307-bf40-0141456ccf89 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:14.754861 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227ae9bd-3d55-4307-bf40-0141456ccf89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:14.774047 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-227ae9bd-3d55-4307-bf40-0141456ccf89 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:56:14.775277 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-227ae9bd-3d55-4307-bf40-0141456ccf89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:56:14.836537 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 578/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:56:14 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:56:15.019976 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bc0c9-90c2-49ec-8a85-62394920a079 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:56:15.021777 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-944bc0c9-90c2-49ec-8a85-62394920a079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:56:15.094047 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944bc0c9-90c2-49ec-8a85-62394920a079 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:56:15.099027 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c7ee3-65b8-4fe6-8d4c-4b0924068487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:56:15.100180 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c7ee3-65b8-4fe6-8d4c-4b0924068487 service nova] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:15.100497 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c7ee3-65b8-4fe6-8d4c-4b0924068487 service nova] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:15.100780 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c7ee3-65b8-4fe6-8d4c-4b0924068487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:15.110630 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c7ee3-65b8-4fe6-8d4c-4b0924068487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:56:15.112259 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c7ee3-65b8-4fe6-8d4c-4b0924068487 service nova] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:56:15.123312 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 552/1130] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:56:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:56:16.047167 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f9311-5eac-4fa1-903c-f947fbfc4e21 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:16.047718 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f9311-5eac-4fa1-903c-f947fbfc4e21 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:16.047718 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8f9311-5eac-4fa1-903c-f947fbfc4e21 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:16.049121 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 579/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:56:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:56:16.054378 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7279f12-e4fb-4677-ad9b-5a7b616e620b None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:16.054846 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7279f12-e4fb-4677-ad9b-5a7b616e620b None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:16.054955 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7279f12-e4fb-4677-ad9b-5a7b616e620b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:16.073918 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-c7279f12-e4fb-4677-ad9b-5a7b616e620b None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:56:16.081127 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-c7279f12-e4fb-4677-ad9b-5a7b616e620b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:56:16.083350 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 553/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:56:16 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:56:16.241621 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f9311-5eac-4fa1-903c-f947fbfc4e21 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:56:16.257558 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8f9311-5eac-4fa1-903c-f947fbfc4e21 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:56:16.262564 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2244b32-1ab7-41ac-a2ee-3929efea3b14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:56:16.263261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2244b32-1ab7-41ac-a2ee-3929efea3b14 service nova] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:16.263632 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2244b32-1ab7-41ac-a2ee-3929efea3b14 service nova] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:16.263825 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2244b32-1ab7-41ac-a2ee-3929efea3b14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:16.272973 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2244b32-1ab7-41ac-a2ee-3929efea3b14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:56:16.274592 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2244b32-1ab7-41ac-a2ee-3929efea3b14 service nova] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:56:16.285053 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 580/1133] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:56:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:56:20.736622 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96e900-322e-44a4-a71d-c24b251b21bc None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:20.737202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96e900-322e-44a4-a71d-c24b251b21bc None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:20.737202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96e900-322e-44a4-a71d-c24b251b21bc None None] PATH_INFO: `/v3` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:20.738507 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 554/1134] 10.222.0.76 () {54 vars in 925 bytes} [Wed May 25 15:56:20 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 15:56:20.744470 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8cbdb-423e-4926-92e1-92e9a7f6e827 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:20.744927 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8cbdb-423e-4926-92e1-92e9a7f6e827 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:20.745031 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8cbdb-423e-4926-92e1-92e9a7f6e827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:20.775359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-acd8cbdb-423e-4926-92e1-92e9a7f6e827 None None] MFA Rules not processed for user `2506613903044131b9e8c75196de862b`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:56:20.776609 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-acd8cbdb-423e-4926-92e1-92e9a7f6e827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:56:20.838132 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 581/1135] 10.222.0.76 () {58 vars in 1015 bytes} [Wed May 25 15:56:20 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:56:25.141561 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d1753-119f-4d7d-b47f-3943902f41de None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:25.142083 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d1753-119f-4d7d-b47f-3943902f41de None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:25.142187 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d1753-119f-4d7d-b47f-3943902f41de None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:25.143487 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 555/1136] 10.222.0.62 () {54 vars in 960 bytes} [Wed May 25 15:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:56:25.149046 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5d8d2-7a43-4a8a-b410-bd3ec867b112 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:25.149544 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5d8d2-7a43-4a8a-b410-bd3ec867b112 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:25.149784 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5d8d2-7a43-4a8a-b410-bd3ec867b112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:25.168034 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-6ce5d8d2-7a43-4a8a-b410-bd3ec867b112 None None] MFA Rules not processed for user `2506613903044131b9e8c75196de862b`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:56:25.169279 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-6ce5d8d2-7a43-4a8a-b410-bd3ec867b112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:56:25.178413 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 582/1137] 10.222.0.62 () {58 vars in 1057 bytes} [Wed May 25 15:56:25 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:56:25.186039 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d1753-119f-4d7d-b47f-3943902f41de None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:56:25.200143 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d1753-119f-4d7d-b47f-3943902f41de None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:56:25.205178 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a4539-cd86-485e-827c-6623b79d67b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2506613903044131b9e8c75196de862b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:56:25.205819 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a4539-cd86-485e-827c-6623b79d67b2 service placement] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:25.206101 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a4539-cd86-485e-827c-6623b79d67b2 service placement] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:25.206374 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a4539-cd86-485e-827c-6623b79d67b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:25.216559 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a4539-cd86-485e-827c-6623b79d67b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:56:25.218223 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a4539-cd86-485e-827c-6623b79d67b2 service placement] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:56:25.228895 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 556/1138] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:56:25 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:56:27.564191 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eecfba-5aba-47c7-81eb-758d85c5fb80 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:27.564772 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eecfba-5aba-47c7-81eb-758d85c5fb80 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:27.564880 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eecfba-5aba-47c7-81eb-758d85c5fb80 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:27.566187 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 583/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:56:27.571292 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ead55f-7268-4005-abce-8cce7b0401d8 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:27.571744 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ead55f-7268-4005-abce-8cce7b0401d8 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:27.571842 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ead55f-7268-4005-abce-8cce7b0401d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:27.591987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-12ead55f-7268-4005-abce-8cce7b0401d8 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:56:27.593220 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-12ead55f-7268-4005-abce-8cce7b0401d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:56:27.600991 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 557/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:56:27 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:56:27.759870 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eecfba-5aba-47c7-81eb-758d85c5fb80 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:56:27.773322 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eecfba-5aba-47c7-81eb-758d85c5fb80 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:56:27.778312 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf93682-1594-47ac-b5d9-ef7b8b13a9a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:56:27.778962 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf93682-1594-47ac-b5d9-ef7b8b13a9a3 service nova] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:27.779245 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf93682-1594-47ac-b5d9-ef7b8b13a9a3 service nova] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:27.779519 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf93682-1594-47ac-b5d9-ef7b8b13a9a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:27.789257 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf93682-1594-47ac-b5d9-ef7b8b13a9a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:56:27.790858 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf93682-1594-47ac-b5d9-ef7b8b13a9a3 service nova] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:56:27.801194 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 584/1141] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:56:27 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:56:28.718236 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855d350-914b-4f98-acbe-d14036e1586c None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:28.718828 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855d350-914b-4f98-acbe-d14036e1586c None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:28.718828 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855d350-914b-4f98-acbe-d14036e1586c None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:28.720227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 558/1142] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 15:56:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:56:28.727204 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec70606-0cb2-4dcf-b9c9-1eead50a07f1 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:28.727778 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec70606-0cb2-4dcf-b9c9-1eead50a07f1 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:28.727889 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec70606-0cb2-4dcf-b9c9-1eead50a07f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:28.748287 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-4ec70606-0cb2-4dcf-b9c9-1eead50a07f1 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:56:28.749552 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-4ec70606-0cb2-4dcf-b9c9-1eead50a07f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:56:28.758546 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 585/1143] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 15:56:28 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:56:28.916214 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855d350-914b-4f98-acbe-d14036e1586c None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:56:28.930258 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855d350-914b-4f98-acbe-d14036e1586c None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:56:28.935262 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bddd3d8-a65e-4327-953d-7eb947077afd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:56:28.935919 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddd3d8-a65e-4327-953d-7eb947077afd service nova] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:28.936208 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddd3d8-a65e-4327-953d-7eb947077afd service nova] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:28.936524 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bddd3d8-a65e-4327-953d-7eb947077afd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:28.946482 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bddd3d8-a65e-4327-953d-7eb947077afd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:56:28.948097 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bddd3d8-a65e-4327-953d-7eb947077afd service nova] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:56:28.957953 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 559/1144] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:56:28 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:56:33.261386 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd176cce-0e08-40a3-af42-0a33ccca23ab None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:33.261965 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd176cce-0e08-40a3-af42-0a33ccca23ab None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:33.261965 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd176cce-0e08-40a3-af42-0a33ccca23ab None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:33.263284 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 586/1145] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:56:33.268538 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afd92f-6fd3-48b5-875e-2d52605cf124 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:33.269040 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afd92f-6fd3-48b5-875e-2d52605cf124 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:33.269179 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17afd92f-6fd3-48b5-875e-2d52605cf124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:33.286981 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-17afd92f-6fd3-48b5-875e-2d52605cf124 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:56:33.288940 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-17afd92f-6fd3-48b5-875e-2d52605cf124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:56:33.296822 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 560/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:56:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:56:33.336408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd176cce-0e08-40a3-af42-0a33ccca23ab None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:56:33.338202 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-fd176cce-0e08-40a3-af42-0a33ccca23ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:56:33.395263 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:56:33.402207 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd176cce-0e08-40a3-af42-0a33ccca23ab None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:56:33.405864 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8bcca8-8f85-4674-814b-11b283802ee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:56:33.412932 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bcca8-8f85-4674-814b-11b283802ee1 service neutron] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:33.412932 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bcca8-8f85-4674-814b-11b283802ee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:33.412932 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8bcca8-8f85-4674-814b-11b283802ee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:33.417040 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8bcca8-8f85-4674-814b-11b283802ee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:56:33.418558 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8bcca8-8f85-4674-814b-11b283802ee1 service neutron] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:56:33.429738 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 587/1147] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:56:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:56:35.748939 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9c985-cd8d-4fa0-92d5-72a88ec01a1b None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:35.749514 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9c985-cd8d-4fa0-92d5-72a88ec01a1b None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:35.749514 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c9c985-cd8d-4fa0-92d5-72a88ec01a1b None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:35.750807 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 561/1148] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:56:35.757060 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf28dcb-04ef-493a-ab3e-e677bf03aaa5 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:35.757558 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf28dcb-04ef-493a-ab3e-e677bf03aaa5 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:35.773538 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf28dcb-04ef-493a-ab3e-e677bf03aaa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:35.776794 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-dbf28dcb-04ef-493a-ab3e-e677bf03aaa5 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:56:35.778019 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-dbf28dcb-04ef-493a-ab3e-e677bf03aaa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:56:35.785854 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 588/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:56:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:56:35.838220 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9c985-cd8d-4fa0-92d5-72a88ec01a1b None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:56:35.838220 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c9c985-cd8d-4fa0-92d5-72a88ec01a1b None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:56:35.840912 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4b432d-6c4d-4be6-a97d-9eb9523a3eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:56:35.841563 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b432d-6c4d-4be6-a97d-9eb9523a3eac service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:35.841846 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b432d-6c4d-4be6-a97d-9eb9523a3eac service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:35.842124 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b432d-6c4d-4be6-a97d-9eb9523a3eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:35.852540 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b432d-6c4d-4be6-a97d-9eb9523a3eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:56:35.854244 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4b432d-6c4d-4be6-a97d-9eb9523a3eac service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:56:35.864855 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 562/1150] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:56:35 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:56:39.916375 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6faa7-5388-4bf1-ba07-87c5cdd073c0 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:39.916974 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6faa7-5388-4bf1-ba07-87c5cdd073c0 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:39.917082 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb6faa7-5388-4bf1-ba07-87c5cdd073c0 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:39.918390 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 589/1151] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:56:39.924505 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d9ba3-846c-4555-b40f-85d3c4ce0c8f None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:39.925310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d9ba3-846c-4555-b40f-85d3c4ce0c8f None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:39.925470 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4d9ba3-846c-4555-b40f-85d3c4ce0c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:39.933676 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=60 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:56:39.946226 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-8a4d9ba3-846c-4555-b40f-85d3c4ce0c8f None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:56:39.949394 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-8a4d9ba3-846c-4555-b40f-85d3c4ce0c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:56:39.955660 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 563/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:56:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:56:40.245229 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6faa7-5388-4bf1-ba07-87c5cdd073c0 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:56:40.247033 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-0cb6faa7-5388-4bf1-ba07-87c5cdd073c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:56:40.307195 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb6faa7-5388-4bf1-ba07-87c5cdd073c0 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:56:40.310776 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f8b4e4-cd66-419f-8e7a-32081d188518 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45fabc3594f64571a0b381990b7974f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:56:40.311427 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8b4e4-cd66-419f-8e7a-32081d188518 service cinder] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:40.311725 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8b4e4-cd66-419f-8e7a-32081d188518 service cinder] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:40.312001 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f8b4e4-cd66-419f-8e7a-32081d188518 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:40.322265 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8b4e4-cd66-419f-8e7a-32081d188518 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:56:40.323710 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f8b4e4-cd66-419f-8e7a-32081d188518 service cinder] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:56:40.333379 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 590/1153] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:56:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:56:42.718627 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00243f6c-0b16-4502-aecc-b2315e708146 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:42.719211 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00243f6c-0b16-4502-aecc-b2315e708146 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:42.719211 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00243f6c-0b16-4502-aecc-b2315e708146 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:42.720622 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 564/1154] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 15:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:56:42.726592 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dae71-367a-4260-abb4-c51d654e9562 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:42.727066 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dae71-367a-4260-abb4-c51d654e9562 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:42.727177 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1dae71-367a-4260-abb4-c51d654e9562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:42.745894 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-7d1dae71-367a-4260-abb4-c51d654e9562 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:56:42.747118 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-7d1dae71-367a-4260-abb4-c51d654e9562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:56:42.755017 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 591/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 15:56:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:56:43.032653 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00243f6c-0b16-4502-aecc-b2315e708146 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:56:43.034376 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-00243f6c-0b16-4502-aecc-b2315e708146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:56:43.048863 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00243f6c-0b16-4502-aecc-b2315e708146 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:56:43.052554 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79fc799-2d95-4bd5-a3c6-7c8dfcf412c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45fabc3594f64571a0b381990b7974f8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:56:43.053858 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fc799-2d95-4bd5-a3c6-7c8dfcf412c3 service cinder] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:56:43.054293 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fc799-2d95-4bd5-a3c6-7c8dfcf412c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:56:43.054571 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79fc799-2d95-4bd5-a3c6-7c8dfcf412c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:56:43.063974 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fc799-2d95-4bd5-a3c6-7c8dfcf412c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:56:43.065422 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79fc799-2d95-4bd5-a3c6-7c8dfcf412c3 service cinder] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:56:43.074824 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 565/1156] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:56:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:56:52.740507 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=37 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:56:53.070763 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=8 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:58:05.611400 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b44259-ae81-41ca-bc99-84bd3f04f0d0 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:05.612045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b44259-ae81-41ca-bc99-84bd3f04f0d0 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:05.612045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b44259-ae81-41ca-bc99-84bd3f04f0d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:05.631556 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-31b44259-ae81-41ca-bc99-84bd3f04f0d0 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:58:05.632545 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3af04d-dfa9-4467-b573-f9a8481d9361 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:05.633061 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-31b44259-ae81-41ca-bc99-84bd3f04f0d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:05.633169 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3af04d-dfa9-4467-b573-f9a8481d9361 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:05.633169 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3af04d-dfa9-4467-b573-f9a8481d9361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:05.642604 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 592/1157] 10.222.0.62 () {58 vars in 957 bytes} [Wed May 25 15:58:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:58:05.653190 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5844cb8-d3a5-4885-a7a3-f508614012d5 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:05.653484 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5844cb8-d3a5-4885-a7a3-f508614012d5 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:05.653784 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5844cb8-d3a5-4885-a7a3-f508614012d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:05.655073 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-cc3af04d-dfa9-4467-b573-f9a8481d9361 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:58:05.656404 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-cc3af04d-dfa9-4467-b573-f9a8481d9361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:05.664962 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 566/1158] 10.222.0.62 () {58 vars in 957 bytes} [Wed May 25 15:58:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:58:05.673589 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-b5844cb8-d3a5-4885-a7a3-f508614012d5 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:58:05.674834 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939edaa-c3cf-4df4-b70f-846db5856921 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:05.674954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-b5844cb8-d3a5-4885-a7a3-f508614012d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:05.675131 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939edaa-c3cf-4df4-b70f-846db5856921 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:05.675416 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939edaa-c3cf-4df4-b70f-846db5856921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:05.682984 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 593/1159] 10.222.0.62 () {58 vars in 957 bytes} [Wed May 25 15:58:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:58:05.688534 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5844cb8-d3a5-4885-a7a3-f508614012d5 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:05.695573 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-6939edaa-c3cf-4df4-b70f-846db5856921 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:58:05.696865 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-6939edaa-c3cf-4df4-b70f-846db5856921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:05.697924 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5844cb8-d3a5-4885-a7a3-f508614012d5 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:05.703031 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4211174-7179-4697-bc0b-ae39eba06aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:05.703662 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4211174-7179-4697-bc0b-ae39eba06aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:05.704003 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4211174-7179-4697-bc0b-ae39eba06aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:05.704286 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4211174-7179-4697-bc0b-ae39eba06aa5 admin admin] PATH_INFO: `/v3/domains` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:05.705258 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4211174-7179-4697-bc0b-ae39eba06aa5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99258) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:58:05.705384 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 567/1160] 10.222.0.62 () {58 vars in 957 bytes} [Wed May 25 15:58:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:58:05.705494 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4211174-7179-4697-bc0b-ae39eba06aa5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:05.707150 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4211174-7179-4697-bc0b-ae39eba06aa5 admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:05.709872 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939edaa-c3cf-4df4-b70f-846db5856921 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:05.719619 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939edaa-c3cf-4df4-b70f-846db5856921 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:05.720689 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 594/1161] 10.222.0.62 () {58 vars in 1152 bytes} [Wed May 25 15:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:58:05.724522 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c9f80-ffa8-4cb1-9c08-56f351c689af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:05.725197 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c9f80-ffa8-4cb1-9c08-56f351c689af admin admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:05.725483 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c9f80-ffa8-4cb1-9c08-56f351c689af admin admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:05.725782 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313c9f80-ffa8-4cb1-9c08-56f351c689af admin admin] PATH_INFO: `/v3/domains` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:05.726519 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c9f80-ffa8-4cb1-9c08-56f351c689af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=99259) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 15:58:05.726829 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c9f80-ffa8-4cb1-9c08-56f351c689af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:05.728120 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: WARNING py.warnings [None req-313c9f80-ffa8-4cb1-9c08-56f351c689af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 15:58:05.728120 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: warnings.warn(msg) May 25 15:58:05.728120 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: May 25 15:58:05.729050 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313c9f80-ffa8-4cb1-9c08-56f351c689af admin admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:05.729170 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4211174-7179-4697-bc0b-ae39eba06aa5 admin admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:05.739846 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4211174-7179-4697-bc0b-ae39eba06aa5 admin admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:05.742357 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 568/1162] 10.222.0.62 () {58 vars in 1152 bytes} [Wed May 25 15:58:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 15:58:05.744691 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fed49-fa90-4eef-a34c-c0db7a3008c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:05.745489 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fed49-fa90-4eef-a34c-c0db7a3008c4 admin admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:05.745850 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fed49-fa90-4eef-a34c-c0db7a3008c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:05.746682 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29fed49-fa90-4eef-a34c-c0db7a3008c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:05.747385 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fed49-fa90-4eef-a34c-c0db7a3008c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:05.748439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: WARNING py.warnings [None req-b29fed49-fa90-4eef-a34c-c0db7a3008c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:58:05.748439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: warnings.warn(msg) May 25 15:58:05.748439 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: May 25 15:58:05.749649 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29fed49-fa90-4eef-a34c-c0db7a3008c4 admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:05.751916 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c9f80-ffa8-4cb1-9c08-56f351c689af admin admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:05.763423 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313c9f80-ffa8-4cb1-9c08-56f351c689af admin admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:05.768291 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732748a-42a2-43fc-aa56-301d3c2966e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:05.769007 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732748a-42a2-43fc-aa56-301d3c2966e5 admin admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:05.769294 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732748a-42a2-43fc-aa56-301d3c2966e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:05.769569 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1732748a-42a2-43fc-aa56-301d3c2966e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:05.770265 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732748a-42a2-43fc-aa56-301d3c2966e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:05.772217 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1732748a-42a2-43fc-aa56-301d3c2966e5 admin admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:05.871694 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 595/1163] 10.222.0.62 () {60 vars in 1152 bytes} [Wed May 25 15:58:05 2022] POST /identity/v3/projects => generated 383 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:58:05.876176 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fed49-fa90-4eef-a34c-c0db7a3008c4 admin admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:05.934248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 569/1164] 10.222.0.62 () {60 vars in 1152 bytes} [Wed May 25 15:58:05 2022] POST /identity/v3/projects => generated 379 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:58:05.938399 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29fed49-fa90-4eef-a34c-c0db7a3008c4 admin admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:05.938743 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732748a-42a2-43fc-aa56-301d3c2966e5 admin admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:05.999781 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819f39a-5a93-479e-8fde-63ed73fd020b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:06.000461 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819f39a-5a93-479e-8fde-63ed73fd020b admin admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:06.000809 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819f39a-5a93-479e-8fde-63ed73fd020b admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:06.000965 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d819f39a-5a93-479e-8fde-63ed73fd020b admin admin] PATH_INFO: `/v3/users` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:06.001664 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819f39a-5a93-479e-8fde-63ed73fd020b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:06.003610 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d819f39a-5a93-479e-8fde-63ed73fd020b admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:06.006012 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1732748a-42a2-43fc-aa56-301d3c2966e5 admin admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:06.010584 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced220f-b326-4a5d-9fda-1ea02d436af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:06.011616 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced220f-b326-4a5d-9fda-1ea02d436af8 admin admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:06.011616 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced220f-b326-4a5d-9fda-1ea02d436af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:06.011836 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cced220f-b326-4a5d-9fda-1ea02d436af8 admin admin] PATH_INFO: `/v3/users` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:06.012734 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced220f-b326-4a5d-9fda-1ea02d436af8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:06.013772 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: WARNING py.warnings [None req-cced220f-b326-4a5d-9fda-1ea02d436af8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:58:06.013772 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: warnings.warn(msg) May 25 15:58:06.013772 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: May 25 15:58:06.014993 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cced220f-b326-4a5d-9fda-1ea02d436af8 admin admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:06.121507 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 596/1165] 10.222.0.62 () {60 vars in 1143 bytes} [Wed May 25 15:58:05 2022] POST /identity/v3/users => generated 292 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:58:06.125466 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819f39a-5a93-479e-8fde-63ed73fd020b admin admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:06.135440 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d819f39a-5a93-479e-8fde-63ed73fd020b admin admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:06.140333 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c81c0-63ab-46d8-8a6f-45c45117d7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:06.141016 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c81c0-63ab-46d8-8a6f-45c45117d7af admin admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:06.141306 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c81c0-63ab-46d8-8a6f-45c45117d7af admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:06.141579 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8c81c0-63ab-46d8-8a6f-45c45117d7af admin admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:06.142410 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c81c0-63ab-46d8-8a6f-45c45117d7af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:06.144007 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8c81c0-63ab-46d8-8a6f-45c45117d7af admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:06.154649 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 597/1166] 10.222.0.62 () {58 vars in 1121 bytes} [Wed May 25 15:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:58:06.158671 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c81c0-63ab-46d8-8a6f-45c45117d7af admin admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:06.166498 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 570/1167] 10.222.0.62 () {60 vars in 1143 bytes} [Wed May 25 15:58:05 2022] POST /identity/v3/users => generated 290 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:58:06.167558 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced220f-b326-4a5d-9fda-1ea02d436af8 admin admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:06.170288 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8c81c0-63ab-46d8-8a6f-45c45117d7af admin admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:06.175329 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed11e0-1de8-4b59-92f1-ba2bb3d0309a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:06.176014 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed11e0-1de8-4b59-92f1-ba2bb3d0309a admin admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:06.176299 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed11e0-1de8-4b59-92f1-ba2bb3d0309a admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:06.176630 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed11e0-1de8-4b59-92f1-ba2bb3d0309a admin admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:06.177387 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed11e0-1de8-4b59-92f1-ba2bb3d0309a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:06.178654 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cced220f-b326-4a5d-9fda-1ea02d436af8 admin admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:06.178970 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed11e0-1de8-4b59-92f1-ba2bb3d0309a admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:06.183700 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891d5bd-33a0-4e35-bf16-ef4794f10935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:06.184438 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891d5bd-33a0-4e35-bf16-ef4794f10935 admin admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:06.184685 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891d5bd-33a0-4e35-bf16-ef4794f10935 admin admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:06.184965 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9891d5bd-33a0-4e35-bf16-ef4794f10935 admin admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:06.185692 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891d5bd-33a0-4e35-bf16-ef4794f10935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:06.187301 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9891d5bd-33a0-4e35-bf16-ef4794f10935 admin admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:06.195459 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 598/1168] 10.222.0.62 () {58 vars in 1121 bytes} [Wed May 25 15:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:58:06.202542 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 571/1169] 10.222.0.62 () {58 vars in 1121 bytes} [Wed May 25 15:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:58:06.202725 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed11e0-1de8-4b59-92f1-ba2bb3d0309a admin admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:06.203414 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891d5bd-33a0-4e35-bf16-ef4794f10935 admin admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:06.209658 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed11e0-1de8-4b59-92f1-ba2bb3d0309a admin admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:06.213229 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9891d5bd-33a0-4e35-bf16-ef4794f10935 admin admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:06.214497 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426631e5-9880-49be-8cbe-9d790a04cc58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:06.216092 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426631e5-9880-49be-8cbe-9d790a04cc58 admin admin] REQUEST_METHOD: `PUT` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:06.216356 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426631e5-9880-49be-8cbe-9d790a04cc58 admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:06.216697 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426631e5-9880-49be-8cbe-9d790a04cc58 admin admin] PATH_INFO: `/v3/projects/df9cf02a012f4994b30eb716f74b04f7/users/7099533d68314bda937af63b3f786eb4/roles/5614294f6ab949a99424ee6e983b6430` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:06.218770 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a3120-41bc-4731-adf2-c8c54a80565e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:06.219405 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a3120-41bc-4731-adf2-c8c54a80565e admin admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:06.219684 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a3120-41bc-4731-adf2-c8c54a80565e admin admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:06.219962 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76a3120-41bc-4731-adf2-c8c54a80565e admin admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:06.220722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a3120-41bc-4731-adf2-c8c54a80565e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:06.222366 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76a3120-41bc-4731-adf2-c8c54a80565e admin admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:06.232565 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426631e5-9880-49be-8cbe-9d790a04cc58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df9cf02a012f4994b30eb716f74b04f7, user_id=7099533d68314bda937af63b3f786eb4, role_id=5614294f6ab949a99424ee6e983b6430)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:06.233604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 572/1170] 10.222.0.62 () {58 vars in 1121 bytes} [Wed May 25 15:58:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:58:06.233755 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: WARNING py.warnings [None req-426631e5-9880-49be-8cbe-9d790a04cc58 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 15:58:06.233755 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: warnings.warn(msg) May 25 15:58:06.233755 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: May 25 15:58:06.235675 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426631e5-9880-49be-8cbe-9d790a04cc58 admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:06.237886 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a3120-41bc-4731-adf2-c8c54a80565e admin admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:06.247791 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76a3120-41bc-4731-adf2-c8c54a80565e admin admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:06.252464 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd886ea-90f8-45f8-8040-4f557254546d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:06.253319 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd886ea-90f8-45f8-8040-4f557254546d admin admin] REQUEST_METHOD: `PUT` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:06.253597 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd886ea-90f8-45f8-8040-4f557254546d admin admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:06.253870 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd886ea-90f8-45f8-8040-4f557254546d admin admin] PATH_INFO: `/v3/projects/847ca411098e4f8695ca267497f7e6d0/users/289049c0c6454660ad11417484de67a9/roles/5614294f6ab949a99424ee6e983b6430` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:06.277865 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd886ea-90f8-45f8-8040-4f557254546d admin admin] RBAC: Authorizing `identity:create_grant(project_id=847ca411098e4f8695ca267497f7e6d0, user_id=289049c0c6454660ad11417484de67a9, role_id=5614294f6ab949a99424ee6e983b6430)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:06.280757 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd886ea-90f8-45f8-8040-4f557254546d admin admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:06.342623 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 599/1171] 10.222.0.62 () {60 vars in 1482 bytes} [Wed May 25 15:58:06 2022] PUT /identity/v3/projects/df9cf02a012f4994b30eb716f74b04f7/users/7099533d68314bda937af63b3f786eb4/roles/5614294f6ab949a99424ee6e983b6430 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:58:06.348039 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4b1c5-02b0-4b4e-8c3d-5d863e9de000 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:06.348366 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4b1c5-02b0-4b4e-8c3d-5d863e9de000 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:06.350572 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f4b1c5-02b0-4b4e-8c3d-5d863e9de000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:06.355097 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:58:06.367988 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-83f4b1c5-02b0-4b4e-8c3d-5d863e9de000 None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:58:06.369695 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-83f4b1c5-02b0-4b4e-8c3d-5d863e9de000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:06.432977 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 573/1172] 10.222.0.62 () {60 vars in 1482 bytes} [Wed May 25 15:58:06 2022] PUT /identity/v3/projects/847ca411098e4f8695ca267497f7e6d0/users/289049c0c6454660ad11417484de67a9/roles/5614294f6ab949a99424ee6e983b6430 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 15:58:06.443763 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 600/1173] 10.222.0.62 () {58 vars in 957 bytes} [Wed May 25 15:58:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:58:06.443987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f101b0-d1f5-48ce-b7ea-8d065397b30f None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:06.443987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f101b0-d1f5-48ce-b7ea-8d065397b30f None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:06.443987 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f101b0-d1f5-48ce-b7ea-8d065397b30f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:06.456534 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4b1c5-02b0-4b4e-8c3d-5d863e9de000 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:06.456774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-83f4b1c5-02b0-4b4e-8c3d-5d863e9de000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:06.465643 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-56f101b0-d1f5-48ce-b7ea-8d065397b30f None None] MFA Rules not processed for user `c9c77caa8ec1422eb63723b3db112685`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:58:06.467275 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-56f101b0-d1f5-48ce-b7ea-8d065397b30f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:06.521293 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f4b1c5-02b0-4b4e-8c3d-5d863e9de000 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:06.535246 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:58:06.552060 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 574/1174] 10.222.0.62 () {58 vars in 957 bytes} [Wed May 25 15:58:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:58:06.563937 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f101b0-d1f5-48ce-b7ea-8d065397b30f None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:06.604690 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0cf1fb-a02e-47f6-81b4-7b68e62f9f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:06.605437 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cf1fb-a02e-47f6-81b4-7b68e62f9f42 service neutron] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:06.605748 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cf1fb-a02e-47f6-81b4-7b68e62f9f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:06.606027 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0cf1fb-a02e-47f6-81b4-7b68e62f9f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:06.616666 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0cf1fb-a02e-47f6-81b4-7b68e62f9f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:06.618173 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0cf1fb-a02e-47f6-81b4-7b68e62f9f42 service neutron] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:06.629992 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 601/1175] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:58:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:58:06.636469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f101b0-d1f5-48ce-b7ea-8d065397b30f None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:06.643235 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4c128-7bb5-4399-8246-bd144ff3f23b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:06.644006 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4c128-7bb5-4399-8246-bd144ff3f23b service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:06.644359 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4c128-7bb5-4399-8246-bd144ff3f23b service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:06.644737 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4c128-7bb5-4399-8246-bd144ff3f23b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:06.658318 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4c128-7bb5-4399-8246-bd144ff3f23b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:06.659821 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4c128-7bb5-4399-8246-bd144ff3f23b service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:06.670368 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 575/1176] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:58:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:58:13.845194 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd12f9-31ae-4fda-aa2b-a584da902d09 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:13.845705 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd12f9-31ae-4fda-aa2b-a584da902d09 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:13.845787 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bd12f9-31ae-4fda-aa2b-a584da902d09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:13.889844 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-03bd12f9-31ae-4fda-aa2b-a584da902d09 None None] MFA Rules not processed for user `7099533d68314bda937af63b3f786eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:58:13.889844 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-03bd12f9-31ae-4fda-aa2b-a584da902d09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:13.941483 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=100 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:58:13.959506 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 602/1177] 10.222.0.62 () {58 vars in 957 bytes} [Wed May 25 15:58:13 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:58:13.964268 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4c128-7bb5-4399-8246-bd144ff3f23b service neutron] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:13.975286 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4c128-7bb5-4399-8246-bd144ff3f23b service neutron] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:13.980504 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c58545-a7a5-47c7-8dc4-8a76023e266f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:13.981359 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c58545-a7a5-47c7-8dc4-8a76023e266f admin admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:13.981648 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c58545-a7a5-47c7-8dc4-8a76023e266f admin admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:13.982116 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c58545-a7a5-47c7-8dc4-8a76023e266f admin admin] PATH_INFO: `/v3/projects` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:13.983009 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c58545-a7a5-47c7-8dc4-8a76023e266f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:13.984869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c58545-a7a5-47c7-8dc4-8a76023e266f admin admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:14.125959 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 576/1178] 10.222.0.62 () {60 vars in 1152 bytes} [Wed May 25 15:58:13 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:58:14.129752 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd12f9-31ae-4fda-aa2b-a584da902d09 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:14.153577 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bd12f9-31ae-4fda-aa2b-a584da902d09 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:14.265129 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920509df-417e-4bfa-84fb-512d49bfe472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:14.266239 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920509df-417e-4bfa-84fb-512d49bfe472 admin admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:14.266623 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920509df-417e-4bfa-84fb-512d49bfe472 admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:14.267000 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920509df-417e-4bfa-84fb-512d49bfe472 admin admin] PATH_INFO: `/v3/users` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:14.267812 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920509df-417e-4bfa-84fb-512d49bfe472 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:14.270015 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920509df-417e-4bfa-84fb-512d49bfe472 admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:14.406388 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 603/1179] 10.222.0.62 () {60 vars in 1143 bytes} [Wed May 25 15:58:14 2022] POST /identity/v3/users => generated 298 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:58:14.407579 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c58545-a7a5-47c7-8dc4-8a76023e266f admin admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:14.420156 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c58545-a7a5-47c7-8dc4-8a76023e266f admin admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:14.425195 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff06128-18ad-480e-8b34-f089a788392a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:14.426095 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff06128-18ad-480e-8b34-f089a788392a admin admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:14.426553 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff06128-18ad-480e-8b34-f089a788392a admin admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:14.426776 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff06128-18ad-480e-8b34-f089a788392a admin admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:14.427497 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff06128-18ad-480e-8b34-f089a788392a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:14.442592 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff06128-18ad-480e-8b34-f089a788392a admin admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:14.456385 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 577/1180] 10.222.0.62 () {58 vars in 1121 bytes} [Wed May 25 15:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:58:14.461854 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920509df-417e-4bfa-84fb-512d49bfe472 admin admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:14.474152 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920509df-417e-4bfa-84fb-512d49bfe472 admin admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:14.481274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8776ef3-4121-4f15-a801-cd0e27a6dc82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:14.482389 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8776ef3-4121-4f15-a801-cd0e27a6dc82 admin admin] REQUEST_METHOD: `PUT` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:14.482857 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8776ef3-4121-4f15-a801-cd0e27a6dc82 admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:14.483288 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8776ef3-4121-4f15-a801-cd0e27a6dc82 admin admin] PATH_INFO: `/v3/projects/d7a3468f08584ff8b73fd7ebc4041277/users/7d44287084874e1abdf2326c2e7565fe/roles/ae72bfdddd1e4a94a21a0d53264ee157` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:14.502356 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8776ef3-4121-4f15-a801-cd0e27a6dc82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a3468f08584ff8b73fd7ebc4041277, user_id=7d44287084874e1abdf2326c2e7565fe, role_id=ae72bfdddd1e4a94a21a0d53264ee157)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:14.503643 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0b373-fb1e-4798-8c10-d5e456827291 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:14.503928 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0b373-fb1e-4798-8c10-d5e456827291 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:14.504202 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba0b373-fb1e-4798-8c10-d5e456827291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:14.505290 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8776ef3-4121-4f15-a801-cd0e27a6dc82 admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:14.538866 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-cba0b373-fb1e-4798-8c10-d5e456827291 None None] MFA Rules not processed for user `289049c0c6454660ad11417484de67a9`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:58:14.540409 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-cba0b373-fb1e-4798-8c10-d5e456827291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:14.617050 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 604/1181] 10.222.0.62 () {60 vars in 1482 bytes} [Wed May 25 15:58:14 2022] PUT /identity/v3/projects/d7a3468f08584ff8b73fd7ebc4041277/users/7d44287084874e1abdf2326c2e7565fe/roles/ae72bfdddd1e4a94a21a0d53264ee157 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:58:14.626149 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8776ef3-4121-4f15-a801-cd0e27a6dc82 admin admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:14.678476 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 578/1182] 10.222.0.62 () {58 vars in 957 bytes} [Wed May 25 15:58:14 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:58:14.679853 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0b373-fb1e-4798-8c10-d5e456827291 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:14.709201 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba0b373-fb1e-4798-8c10-d5e456827291 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:14.755707 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8776ef3-4121-4f15-a801-cd0e27a6dc82 admin admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:14.762776 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d881afc-10ec-4e06-acc1-ddd26033db88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:14.763479 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d881afc-10ec-4e06-acc1-ddd26033db88 admin admin] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:14.763761 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d881afc-10ec-4e06-acc1-ddd26033db88 admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:14.764039 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d881afc-10ec-4e06-acc1-ddd26033db88 admin admin] PATH_INFO: `/v3/roles` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:14.764996 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d881afc-10ec-4e06-acc1-ddd26033db88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:14.766918 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d881afc-10ec-4e06-acc1-ddd26033db88 admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:14.792297 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 605/1183] 10.222.0.62 () {58 vars in 1121 bytes} [Wed May 25 15:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 15:58:14.795035 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d881afc-10ec-4e06-acc1-ddd26033db88 admin admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:14.803314 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:58:14.816228 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44eb1b-15b0-44ce-b015-03dab5489c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:14.816925 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d881afc-10ec-4e06-acc1-ddd26033db88 admin admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:14.818199 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44eb1b-15b0-44ce-b015-03dab5489c8a admin admin] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:14.818483 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44eb1b-15b0-44ce-b015-03dab5489c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:14.818758 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db44eb1b-15b0-44ce-b015-03dab5489c8a admin admin] PATH_INFO: `/v3/projects` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:14.819471 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44eb1b-15b0-44ce-b015-03dab5489c8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:14.821504 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db44eb1b-15b0-44ce-b015-03dab5489c8a admin admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:14.826834 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31251b9-c80e-4cbb-af5e-b3b4aa5f5822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:14.827931 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31251b9-c80e-4cbb-af5e-b3b4aa5f5822 admin admin] REQUEST_METHOD: `PUT` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:14.828212 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31251b9-c80e-4cbb-af5e-b3b4aa5f5822 admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:14.828520 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31251b9-c80e-4cbb-af5e-b3b4aa5f5822 admin admin] PATH_INFO: `/v3/projects/d7a3468f08584ff8b73fd7ebc4041277/users/7d44287084874e1abdf2326c2e7565fe/roles/ae72bfdddd1e4a94a21a0d53264ee157` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:14.830624 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31251b9-c80e-4cbb-af5e-b3b4aa5f5822 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a3468f08584ff8b73fd7ebc4041277, user_id=7d44287084874e1abdf2326c2e7565fe, role_id=ae72bfdddd1e4a94a21a0d53264ee157)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:14.833515 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31251b9-c80e-4cbb-af5e-b3b4aa5f5822 admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:14.850155 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 606/1184] 10.222.0.62 () {60 vars in 1482 bytes} [Wed May 25 15:58:14 2022] PUT /identity/v3/projects/d7a3468f08584ff8b73fd7ebc4041277/users/7d44287084874e1abdf2326c2e7565fe/roles/ae72bfdddd1e4a94a21a0d53264ee157 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:58:14.962206 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 579/1185] 10.222.0.62 () {60 vars in 1152 bytes} [Wed May 25 15:58:14 2022] POST /identity/v3/projects => generated 377 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 15:58:14.967181 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31251b9-c80e-4cbb-af5e-b3b4aa5f5822 admin admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:15.028615 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:58:15.057982 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31251b9-c80e-4cbb-af5e-b3b4aa5f5822 admin admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:15.179107 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce70ce1-aef7-49fa-a383-3a7f9f709139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:15.179907 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce70ce1-aef7-49fa-a383-3a7f9f709139 admin admin] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:15.182051 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce70ce1-aef7-49fa-a383-3a7f9f709139 admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:15.182051 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce70ce1-aef7-49fa-a383-3a7f9f709139 admin admin] PATH_INFO: `/v3/users` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:15.182051 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce70ce1-aef7-49fa-a383-3a7f9f709139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:15.185024 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce70ce1-aef7-49fa-a383-3a7f9f709139 admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:15.306261 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 607/1186] 10.222.0.62 () {60 vars in 1143 bytes} [Wed May 25 15:58:14 2022] POST /identity/v3/users => generated 295 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 15:58:15.308732 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44eb1b-15b0-44ce-b015-03dab5489c8a admin admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:15.322413 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db44eb1b-15b0-44ce-b015-03dab5489c8a admin admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:15.333430 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3522f-2587-43d9-9c15-86291b153c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:15.334133 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3522f-2587-43d9-9c15-86291b153c38 admin admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:15.334422 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3522f-2587-43d9-9c15-86291b153c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:15.334998 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec3522f-2587-43d9-9c15-86291b153c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:15.335554 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3522f-2587-43d9-9c15-86291b153c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:15.337426 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec3522f-2587-43d9-9c15-86291b153c38 admin admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:15.349844 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 580/1187] 10.222.0.62 () {58 vars in 1121 bytes} [Wed May 25 15:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:58:15.356359 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce70ce1-aef7-49fa-a383-3a7f9f709139 admin admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:15.367693 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce70ce1-aef7-49fa-a383-3a7f9f709139 admin admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:15.373459 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0562f-7c42-4134-818b-22dd44a96271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:15.374408 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0562f-7c42-4134-818b-22dd44a96271 admin admin] REQUEST_METHOD: `PUT` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:15.374691 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0562f-7c42-4134-818b-22dd44a96271 admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:15.375023 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc0562f-7c42-4134-818b-22dd44a96271 admin admin] PATH_INFO: `/v3/projects/af7064bfec4b4f649a14fdcc70235453/users/e902af1bd98f4621a68c983535eb5f4d/roles/ae72bfdddd1e4a94a21a0d53264ee157` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:15.395423 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0562f-7c42-4134-818b-22dd44a96271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af7064bfec4b4f649a14fdcc70235453, user_id=e902af1bd98f4621a68c983535eb5f4d, role_id=ae72bfdddd1e4a94a21a0d53264ee157)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:15.398292 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc0562f-7c42-4134-818b-22dd44a96271 admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:15.507064 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 608/1188] 10.222.0.62 () {60 vars in 1482 bytes} [Wed May 25 15:58:15 2022] PUT /identity/v3/projects/af7064bfec4b4f649a14fdcc70235453/users/e902af1bd98f4621a68c983535eb5f4d/roles/ae72bfdddd1e4a94a21a0d53264ee157 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:58:15.511163 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3522f-2587-43d9-9c15-86291b153c38 admin admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:15.525099 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec3522f-2587-43d9-9c15-86291b153c38 admin admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:15.597764 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252d7e4a-b481-4f28-b410-8dd86d4f0b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:15.598469 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d7e4a-b481-4f28-b410-8dd86d4f0b1f admin admin] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:15.598807 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d7e4a-b481-4f28-b410-8dd86d4f0b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:15.599102 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252d7e4a-b481-4f28-b410-8dd86d4f0b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:15.599891 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d7e4a-b481-4f28-b410-8dd86d4f0b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:15.602241 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252d7e4a-b481-4f28-b410-8dd86d4f0b1f admin admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:15.614959 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 581/1189] 10.222.0.62 () {58 vars in 1121 bytes} [Wed May 25 15:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 15:58:15.619173 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0562f-7c42-4134-818b-22dd44a96271 admin admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:15.634653 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc0562f-7c42-4134-818b-22dd44a96271 admin admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:15.642842 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d7f94-c7c3-47e7-9010-5a0ff7fe4d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:15.643871 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d7f94-c7c3-47e7-9010-5a0ff7fe4d4f admin admin] REQUEST_METHOD: `PUT` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:15.644940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d7f94-c7c3-47e7-9010-5a0ff7fe4d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:15.644940 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d7f94-c7c3-47e7-9010-5a0ff7fe4d4f admin admin] PATH_INFO: `/v3/projects/af7064bfec4b4f649a14fdcc70235453/users/e902af1bd98f4621a68c983535eb5f4d/roles/ae72bfdddd1e4a94a21a0d53264ee157` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:15.647307 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d7f94-c7c3-47e7-9010-5a0ff7fe4d4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=af7064bfec4b4f649a14fdcc70235453, user_id=e902af1bd98f4621a68c983535eb5f4d, role_id=ae72bfdddd1e4a94a21a0d53264ee157)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:15.652508 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-951d7f94-c7c3-47e7-9010-5a0ff7fe4d4f admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:15.673610 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 609/1190] 10.222.0.62 () {60 vars in 1482 bytes} [Wed May 25 15:58:15 2022] PUT /identity/v3/projects/af7064bfec4b4f649a14fdcc70235453/users/e902af1bd98f4621a68c983535eb5f4d/roles/ae72bfdddd1e4a94a21a0d53264ee157 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 15:58:22.779563 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a3d7f-1a74-4795-b78e-3122659e91aa None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:22.780135 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a3d7f-1a74-4795-b78e-3122659e91aa None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:22.780397 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a3d7f-1a74-4795-b78e-3122659e91aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:22.827883 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-015a3d7f-1a74-4795-b78e-3122659e91aa None None] MFA Rules not processed for user `7d44287084874e1abdf2326c2e7565fe`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:58:22.832062 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-015a3d7f-1a74-4795-b78e-3122659e91aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:22.973229 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 582/1191] 10.222.0.62 () {58 vars in 957 bytes} [Wed May 25 15:58:22 2022] POST /identity/v3/auth/tokens => generated 2877 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:58:22.993666 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d7f94-c7c3-47e7-9010-5a0ff7fe4d4f admin admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:22.999847 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-951d7f94-c7c3-47e7-9010-5a0ff7fe4d4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:23.074857 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d7f94-c7c3-47e7-9010-5a0ff7fe4d4f admin admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:23.080207 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a9975-204f-4ca3-8343-abcbf832469d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530c527ef42e4f949b15c74206baf99b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:23.080207 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a9975-204f-4ca3-8343-abcbf832469d service glance] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:23.080608 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a9975-204f-4ca3-8343-abcbf832469d service glance] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:23.080982 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a9975-204f-4ca3-8343-abcbf832469d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:23.150526 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:58:23.155662 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a9975-204f-4ca3-8343-abcbf832469d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:23.157171 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a9975-204f-4ca3-8343-abcbf832469d service glance] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:23.167203 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 610/1192] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:58:22 2022] GET /identity/v3/auth/tokens => generated 2810 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:58:23.651971 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc5e29-6cb6-4dec-87d3-0fcdf749f86b None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:23.652263 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc5e29-6cb6-4dec-87d3-0fcdf749f86b None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:23.652597 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bc5e29-6cb6-4dec-87d3-0fcdf749f86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:23.703609 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-a5bc5e29-6cb6-4dec-87d3-0fcdf749f86b None None] MFA Rules not processed for user `e902af1bd98f4621a68c983535eb5f4d`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:58:23.704483 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-a5bc5e29-6cb6-4dec-87d3-0fcdf749f86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:23.767144 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:58:23.807142 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 583/1193] 10.222.0.62 () {58 vars in 957 bytes} [Wed May 25 15:58:23 2022] POST /identity/v3/auth/tokens => generated 2871 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:58:23.826312 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a9975-204f-4ca3-8343-abcbf832469d service glance] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:23.838358 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a9975-204f-4ca3-8343-abcbf832469d service glance] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:23.843092 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafb6c10-8264-42f1-877d-29bd2511e630 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530c527ef42e4f949b15c74206baf99b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:23.843887 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb6c10-8264-42f1-877d-29bd2511e630 service glance] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:23.844274 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb6c10-8264-42f1-877d-29bd2511e630 service glance] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:23.844814 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafb6c10-8264-42f1-877d-29bd2511e630 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:23.939838 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb6c10-8264-42f1-877d-29bd2511e630 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:23.941361 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafb6c10-8264-42f1-877d-29bd2511e630 service glance] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:23.954844 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 611/1194] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:58:23 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:58:33.171348 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e319774-fa45-4519-b659-3bd65761e619 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:33.171348 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e319774-fa45-4519-b659-3bd65761e619 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:33.171348 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e319774-fa45-4519-b659-3bd65761e619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:33.190527 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-3e319774-fa45-4519-b659-3bd65761e619 None None] MFA Rules not processed for user `7099533d68314bda937af63b3f786eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:58:33.191782 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-3e319774-fa45-4519-b659-3bd65761e619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:33.200012 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 584/1195] 10.222.0.62 () {58 vars in 957 bytes} [Wed May 25 15:58:33 2022] POST /identity/v3/auth/tokens => generated 2810 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:58:33.500791 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb5f8d-77d8-4650-98d1-87d49b6b3096 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:33.501496 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb5f8d-77d8-4650-98d1-87d49b6b3096 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:33.501496 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bb5f8d-77d8-4650-98d1-87d49b6b3096 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:33.502827 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 612/1196] 10.222.0.62 () {54 vars in 961 bytes} [Wed May 25 15:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:58:33.508730 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bce4b5-91c9-452b-ba20-4f0d0d6bef9c None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:33.511854 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bce4b5-91c9-452b-ba20-4f0d0d6bef9c None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:33.511854 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bce4b5-91c9-452b-ba20-4f0d0d6bef9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:33.529791 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-00bce4b5-91c9-452b-ba20-4f0d0d6bef9c None None] MFA Rules not processed for user `d9b8b255e35c4949ba8faeb79921f141`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:58:33.531076 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-00bce4b5-91c9-452b-ba20-4f0d0d6bef9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:33.604126 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 585/1197] 10.222.0.62 () {58 vars in 1058 bytes} [Wed May 25 15:58:33 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:58:33.609595 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1151c4-918b-4966-8454-fea1451a66a2 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:33.609927 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1151c4-918b-4966-8454-fea1451a66a2 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:33.610208 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1151c4-918b-4966-8454-fea1451a66a2 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:33.611711 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 613/1198] 10.222.0.62 () {54 vars in 912 bytes} [Wed May 25 15:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:58:33.617493 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab85677-e4a8-4884-82f9-c346272aabc1 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:33.617786 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab85677-e4a8-4884-82f9-c346272aabc1 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:33.618073 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab85677-e4a8-4884-82f9-c346272aabc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:33.641253 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-aab85677-e4a8-4884-82f9-c346272aabc1 None None] MFA Rules not processed for user `d9b8b255e35c4949ba8faeb79921f141`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:58:33.642708 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-aab85677-e4a8-4884-82f9-c346272aabc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:33.653527 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 586/1199] 10.222.0.62 () {58 vars in 1009 bytes} [Wed May 25 15:58:33 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:58:33.669024 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1151c4-918b-4966-8454-fea1451a66a2 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:33.672159 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-2a1151c4-918b-4966-8454-fea1451a66a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:33.685976 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1151c4-918b-4966-8454-fea1451a66a2 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:33.693361 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503cd491-6403-47f6-b043-d6ae4a4901d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '530c527ef42e4f949b15c74206baf99b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:33.694476 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cd491-6403-47f6-b043-d6ae4a4901d7 service glance] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:33.694873 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cd491-6403-47f6-b043-d6ae4a4901d7 service glance] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:33.695201 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503cd491-6403-47f6-b043-d6ae4a4901d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:33.706103 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503cd491-6403-47f6-b043-d6ae4a4901d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:33.707558 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503cd491-6403-47f6-b043-d6ae4a4901d7 service glance] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:33.718984 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 614/1200] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:58:33 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:58:34.107341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448788b-ef69-4f4c-826a-cb52a6bd267f None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:34.107667 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448788b-ef69-4f4c-826a-cb52a6bd267f None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:34.107978 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f448788b-ef69-4f4c-826a-cb52a6bd267f None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:34.109407 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 587/1201] 10.222.0.62 () {54 vars in 912 bytes} [Wed May 25 15:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:58:34.118670 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4737ba-f743-4cc0-b0fa-c2de54b71a30 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:34.118966 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4737ba-f743-4cc0-b0fa-c2de54b71a30 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:34.119303 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4737ba-f743-4cc0-b0fa-c2de54b71a30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:34.146891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-2c4737ba-f743-4cc0-b0fa-c2de54b71a30 None None] MFA Rules not processed for user `d1cb7a1be78c4b55b5ec991b99d47020`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:58:34.148105 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-2c4737ba-f743-4cc0-b0fa-c2de54b71a30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:34.218954 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 615/1202] 10.222.0.62 () {58 vars in 1009 bytes} [Wed May 25 15:58:34 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:58:34.233055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448788b-ef69-4f4c-826a-cb52a6bd267f None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:34.259947 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f448788b-ef69-4f4c-826a-cb52a6bd267f None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:34.269058 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857aab2d-8a46-487f-be62-c5c5e74dc56e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:34.270299 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857aab2d-8a46-487f-be62-c5c5e74dc56e service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:34.271104 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857aab2d-8a46-487f-be62-c5c5e74dc56e service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:34.271684 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857aab2d-8a46-487f-be62-c5c5e74dc56e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:34.291182 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857aab2d-8a46-487f-be62-c5c5e74dc56e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:34.293582 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857aab2d-8a46-487f-be62-c5c5e74dc56e service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:34.306055 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 588/1203] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:58:34 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:58:34.852753 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32357c08-e4df-4ea9-b595-6d80929db290 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:34.853141 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32357c08-e4df-4ea9-b595-6d80929db290 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:34.853452 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32357c08-e4df-4ea9-b595-6d80929db290 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:34.855297 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 616/1204] 10.222.0.62 () {54 vars in 961 bytes} [Wed May 25 15:58:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:58:34.861814 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea6a1-e4a0-4837-ba07-b6218c323a50 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:34.862194 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea6a1-e4a0-4837-ba07-b6218c323a50 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:34.862547 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678ea6a1-e4a0-4837-ba07-b6218c323a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:34.871377 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da9630-d6b9-4839-af20-8a28b8dbcd77 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:34.871952 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da9630-d6b9-4839-af20-8a28b8dbcd77 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:34.872244 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91da9630-d6b9-4839-af20-8a28b8dbcd77 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:34.877973 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 617/1205] 10.222.0.62 () {54 vars in 960 bytes} [Wed May 25 15:58:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:58:34.880370 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9e25f-83c9-41f3-902a-abb1af310931 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:34.880833 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9e25f-83c9-41f3-902a-abb1af310931 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:34.881119 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa9e25f-83c9-41f3-902a-abb1af310931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:34.886354 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-678ea6a1-e4a0-4837-ba07-b6218c323a50 None None] MFA Rules not processed for user `d9b8b255e35c4949ba8faeb79921f141`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:58:34.887583 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-678ea6a1-e4a0-4837-ba07-b6218c323a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:34.900354 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-9fa9e25f-83c9-41f3-902a-abb1af310931 None None] MFA Rules not processed for user `2506613903044131b9e8c75196de862b`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:58:34.901706 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-9fa9e25f-83c9-41f3-902a-abb1af310931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:34.902444 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 589/1206] 10.222.0.62 () {58 vars in 1058 bytes} [Wed May 25 15:58:34 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:58:34.908832 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da52d93-cb07-4b01-afe4-84d167b1343c None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:34.909203 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da52d93-cb07-4b01-afe4-84d167b1343c None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:34.909554 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da52d93-cb07-4b01-afe4-84d167b1343c None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:34.911337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 590/1207] 10.222.0.62 () {54 vars in 912 bytes} [Wed May 25 15:58:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 15:58:34.916884 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175ec96-790b-434e-81d7-874b31906422 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:34.920823 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175ec96-790b-434e-81d7-874b31906422 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:34.920823 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a175ec96-790b-434e-81d7-874b31906422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:34.938291 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-a175ec96-790b-434e-81d7-874b31906422 None None] MFA Rules not processed for user `d9b8b255e35c4949ba8faeb79921f141`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:58:34.939607 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-a175ec96-790b-434e-81d7-874b31906422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:34.948942 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 591/1208] 10.222.0.62 () {58 vars in 1009 bytes} [Wed May 25 15:58:34 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:58:34.961324 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175ec96-790b-434e-81d7-874b31906422 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:34.972488 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a175ec96-790b-434e-81d7-874b31906422 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:34.977834 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638c2db-4703-4c9a-8e50-8b81f086be43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:34.978495 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638c2db-4703-4c9a-8e50-8b81f086be43 service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:34.978784 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638c2db-4703-4c9a-8e50-8b81f086be43 service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:34.979062 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638c2db-4703-4c9a-8e50-8b81f086be43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:34.984878 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 618/1209] 10.222.0.62 () {58 vars in 1057 bytes} [Wed May 25 15:58:34 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:58:34.990538 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638c2db-4703-4c9a-8e50-8b81f086be43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:34.991993 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638c2db-4703-4c9a-8e50-8b81f086be43 service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:34.992833 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9e25f-83c9-41f3-902a-abb1af310931 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:35.003791 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa9e25f-83c9-41f3-902a-abb1af310931 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:35.004658 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 592/1210] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:58:34 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 15:58:35.014985 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a4ae1-ff82-4a3f-9c7b-b03a938e9cfe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2506613903044131b9e8c75196de862b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:35.014985 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a4ae1-ff82-4a3f-9c7b-b03a938e9cfe service placement] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:35.014985 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a4ae1-ff82-4a3f-9c7b-b03a938e9cfe service placement] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:35.014985 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8a4ae1-ff82-4a3f-9c7b-b03a938e9cfe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:35.017007 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-dc8a4ae1-ff82-4a3f-9c7b-b03a938e9cfe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:35.030684 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a4ae1-ff82-4a3f-9c7b-b03a938e9cfe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:35.032352 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8a4ae1-ff82-4a3f-9c7b-b03a938e9cfe service placement] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:35.046318 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 619/1211] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:58:34 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:58:44.999424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=64 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:58:45.041103 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=95 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:58:45.637601 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f0b04-d2e2-42ca-baca-f7fc7298def4 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:45.641168 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f0b04-d2e2-42ca-baca-f7fc7298def4 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:45.641168 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55f0b04-d2e2-42ca-baca-f7fc7298def4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:45.660379 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-b55f0b04-d2e2-42ca-baca-f7fc7298def4 None None] MFA Rules not processed for user `d1cb7a1be78c4b55b5ec991b99d47020`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:58:45.661779 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-b55f0b04-d2e2-42ca-baca-f7fc7298def4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:45.670873 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 593/1212] 10.222.0.76 () {58 vars in 1015 bytes} [Wed May 25 15:58:45 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 15:58:45.709290 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a4ae1-ff82-4a3f-9c7b-b03a938e9cfe service placement] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:45.727498 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8a4ae1-ff82-4a3f-9c7b-b03a938e9cfe service placement] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:45.736208 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b28ceef-536a-48df-8010-da3e0db47bec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:45.737595 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28ceef-536a-48df-8010-da3e0db47bec service neutron] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:45.738444 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28ceef-536a-48df-8010-da3e0db47bec service neutron] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:45.739072 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b28ceef-536a-48df-8010-da3e0db47bec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:45.754608 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28ceef-536a-48df-8010-da3e0db47bec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:45.757509 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b28ceef-536a-48df-8010-da3e0db47bec service neutron] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:45.773135 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 620/1213] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:58:45 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:58:47.543905 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c353bc6-5cf7-4e46-b3fc-e3055538593f None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:47.544560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c353bc6-5cf7-4e46-b3fc-e3055538593f None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:47.544560 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c353bc6-5cf7-4e46-b3fc-e3055538593f None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:47.547574 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 594/1214] 10.222.0.62 () {54 vars in 921 bytes} [Wed May 25 15:58:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:58:47.558285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07707d8a-f34c-4f27-8b84-6f09730638dd None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:47.558891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07707d8a-f34c-4f27-8b84-6f09730638dd None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:47.558891 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07707d8a-f34c-4f27-8b84-6f09730638dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:47.590905 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-07707d8a-f34c-4f27-8b84-6f09730638dd None None] MFA Rules not processed for user `d9b8b255e35c4949ba8faeb79921f141`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:58:47.592708 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-07707d8a-f34c-4f27-8b84-6f09730638dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:47.603635 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 621/1215] 10.222.0.62 () {58 vars in 1018 bytes} [Wed May 25 15:58:47 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:58:47.619045 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c353bc6-5cf7-4e46-b3fc-e3055538593f None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:47.633767 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c353bc6-5cf7-4e46-b3fc-e3055538593f None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:47.640801 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084237d0-5e38-487f-90ff-1e57ae7a1072 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:47.641602 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084237d0-5e38-487f-90ff-1e57ae7a1072 service nova] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:47.641969 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084237d0-5e38-487f-90ff-1e57ae7a1072 service nova] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:47.642253 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084237d0-5e38-487f-90ff-1e57ae7a1072 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:47.652310 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084237d0-5e38-487f-90ff-1e57ae7a1072 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:47.656265 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084237d0-5e38-487f-90ff-1e57ae7a1072 service nova] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:47.666764 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 595/1216] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:58:47 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:58:55.216268 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7538ff9-bca7-4efa-9c67-45e2b06b6822 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:55.216774 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7538ff9-bca7-4efa-9c67-45e2b06b6822 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:55.217161 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7538ff9-bca7-4efa-9c67-45e2b06b6822 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:55.219266 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 622/1217] 10.222.0.62 () {54 vars in 921 bytes} [Wed May 25 15:58:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 15:58:55.229401 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84f142-2700-44d0-a7cf-b99f2c189666 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:55.229994 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84f142-2700-44d0-a7cf-b99f2c189666 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:55.229994 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc84f142-2700-44d0-a7cf-b99f2c189666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:55.252882 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-bc84f142-2700-44d0-a7cf-b99f2c189666 None None] MFA Rules not processed for user `d9b8b255e35c4949ba8faeb79921f141`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 15:58:55.254410 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-bc84f142-2700-44d0-a7cf-b99f2c189666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 15:58:55.270604 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 596/1218] 10.222.0.62 () {58 vars in 1018 bytes} [Wed May 25 15:58:55 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 15:58:55.284402 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7538ff9-bca7-4efa-9c67-45e2b06b6822 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:58:55.298621 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7538ff9-bca7-4efa-9c67-45e2b06b6822 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:58:55.305604 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753655c9-f938-4cc2-a430-45f679b22094 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:58:55.306256 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753655c9-f938-4cc2-a430-45f679b22094 service nova] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:58:55.306545 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753655c9-f938-4cc2-a430-45f679b22094 service nova] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:58:55.306822 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753655c9-f938-4cc2-a430-45f679b22094 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:58:55.324045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753655c9-f938-4cc2-a430-45f679b22094 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:58:55.324045 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753655c9-f938-4cc2-a430-45f679b22094 service nova] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:58:55.333890 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 623/1219] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:58:55 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:59:05.246342 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=12 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:59:05.329039 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=15 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 15:59:09.358907 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84f142-2700-44d0-a7cf-b99f2c189666 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 15:59:09.369046 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc84f142-2700-44d0-a7cf-b99f2c189666 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 15:59:09.372731 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b7e906-e17d-42fb-9572-02b400c98a0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 15:59:09.373390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7e906-e17d-42fb-9572-02b400c98a0a service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 15:59:09.373676 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7e906-e17d-42fb-9572-02b400c98a0a service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 15:59:09.373957 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b7e906-e17d-42fb-9572-02b400c98a0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 15:59:09.384253 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7e906-e17d-42fb-9572-02b400c98a0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 15:59:09.387056 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b7e906-e17d-42fb-9572-02b400c98a0a service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 15:59:09.396649 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 597/1220] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 15:59:09 2022] GET /identity/v3/auth/tokens => generated 2877 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 15:59:19.391791 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=6 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:00:31.053241 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c015b12-8e0e-47ec-a01f-ac1faa0558cb None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:00:31.053832 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c015b12-8e0e-47ec-a01f-ac1faa0558cb None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:00:31.053832 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c015b12-8e0e-47ec-a01f-ac1faa0558cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:00:31.083353 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-5c015b12-8e0e-47ec-a01f-ac1faa0558cb None None] MFA Rules not processed for user `289049c0c6454660ad11417484de67a9`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:00:31.084605 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-5c015b12-8e0e-47ec-a01f-ac1faa0558cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:00:31.114454 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 624/1221] 10.222.0.62 () {58 vars in 957 bytes} [Wed May 25 16:00:31 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:00:40.157926 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d24db-d29a-497d-9247-cc9db5390dc9 None None] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:00:40.158898 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d24db-d29a-497d-9247-cc9db5390dc9 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:00:40.159463 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d24db-d29a-497d-9247-cc9db5390dc9 None None] PATH_INFO: `/` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:00:40.161460 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 598/1222] 10.222.0.62 () {54 vars in 921 bytes} [Wed May 25 16:00:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:00:40.169865 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b78ba-703e-4da4-b8b8-031f1ddbb890 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:00:40.170988 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b78ba-703e-4da4-b8b8-031f1ddbb890 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:00:40.171303 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222b78ba-703e-4da4-b8b8-031f1ddbb890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:00:40.266938 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-222b78ba-703e-4da4-b8b8-031f1ddbb890 None None] MFA Rules not processed for user `2506613903044131b9e8c75196de862b`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:00:40.268232 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-222b78ba-703e-4da4-b8b8-031f1ddbb890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:00:40.325793 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 625/1223] 10.222.0.62 () {58 vars in 1018 bytes} [Wed May 25 16:00:40 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:00:40.487367 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d24db-d29a-497d-9247-cc9db5390dc9 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:00:40.501063 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d24db-d29a-497d-9247-cc9db5390dc9 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:00:40.506542 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499ecad-7992-419d-a669-2dda4c6f04d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2506613903044131b9e8c75196de862b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:00:40.507191 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499ecad-7992-419d-a669-2dda4c6f04d9 service placement] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:00:40.507499 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499ecad-7992-419d-a669-2dda4c6f04d9 service placement] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:00:40.507803 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499ecad-7992-419d-a669-2dda4c6f04d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:00:40.517287 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499ecad-7992-419d-a669-2dda4c6f04d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:00:40.518871 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499ecad-7992-419d-a669-2dda4c6f04d9 service placement] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:00:40.529300 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 599/1224] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 16:00:40 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:00:45.097576 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe2602-2442-472b-ace5-925dc99fd7a9 None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:00:45.098224 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe2602-2442-472b-ace5-925dc99fd7a9 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:00:45.098224 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe2602-2442-472b-ace5-925dc99fd7a9 None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:00:45.099659 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 626/1225] 10.222.0.62 () {54 vars in 921 bytes} [Wed May 25 16:00:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:00:45.116990 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9a452-f87c-4b65-b90c-6913b239f192 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:00:45.118537 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9a452-f87c-4b65-b90c-6913b239f192 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:00:45.119237 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c9a452-f87c-4b65-b90c-6913b239f192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:00:45.140563 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-89c9a452-f87c-4b65-b90c-6913b239f192 None None] MFA Rules not processed for user `2506613903044131b9e8c75196de862b`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:00:45.141777 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-89c9a452-f87c-4b65-b90c-6913b239f192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:00:45.150808 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 600/1226] 10.222.0.62 () {58 vars in 1018 bytes} [Wed May 25 16:00:45 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:00:45.315127 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe2602-2442-472b-ace5-925dc99fd7a9 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:00:45.329805 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe2602-2442-472b-ace5-925dc99fd7a9 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:00:45.334865 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900613f4-a18e-4553-a450-c390775362cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2506613903044131b9e8c75196de862b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:00:45.335818 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900613f4-a18e-4553-a450-c390775362cd service placement] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:00:45.335951 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900613f4-a18e-4553-a450-c390775362cd service placement] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:00:45.337766 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900613f4-a18e-4553-a450-c390775362cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:00:45.347125 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900613f4-a18e-4553-a450-c390775362cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:00:45.352162 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900613f4-a18e-4553-a450-c390775362cd service placement] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:00:45.370916 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 627/1227] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 16:00:45 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:00:45.414076 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9a452-f87c-4b65-b90c-6913b239f192 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:00:45.506915 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c9a452-f87c-4b65-b90c-6913b239f192 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:00:45.512878 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66d857-1c13-437b-b1f6-0c47d0885be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:00:45.513776 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66d857-1c13-437b-b1f6-0c47d0885be7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:00:45.514057 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66d857-1c13-437b-b1f6-0c47d0885be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:00:45.514337 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66d857-1c13-437b-b1f6-0c47d0885be7 admin admin] PATH_INFO: `/v3/users/7099533d68314bda937af63b3f786eb4` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:00:45.515602 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66d857-1c13-437b-b1f6-0c47d0885be7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7099533d68314bda937af63b3f786eb4)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:00:45.517626 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66d857-1c13-437b-b1f6-0c47d0885be7 admin admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:00:45.744895 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-0b66d857-1c13-437b-b1f6-0c47d0885be7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7099533d68314bda937af63b3f786eb4'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:00:45.745625 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-0b66d857-1c13-437b-b1f6-0c47d0885be7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7099533d68314bda937af63b3f786eb4'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:00:45.759701 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-0b66d857-1c13-437b-b1f6-0c47d0885be7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7099533d68314bda937af63b3f786eb4'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:00:45.781486 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-0b66d857-1c13-437b-b1f6-0c47d0885be7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7099533d68314bda937af63b3f786eb4'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:00:45.782391 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-0b66d857-1c13-437b-b1f6-0c47d0885be7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7099533d68314bda937af63b3f786eb4'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:00:45.902026 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 601/1228] 10.222.0.62 () {58 vars in 1223 bytes} [Wed May 25 16:00:45 2022] DELETE /identity/v3/users/7099533d68314bda937af63b3f786eb4 => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:00:46.254554 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900613f4-a18e-4553-a450-c390775362cd service placement] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:00:46.266538 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900613f4-a18e-4553-a450-c390775362cd service placement] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:00:46.331621 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e8d2e-050a-43c2-8eaf-a89e80ccf2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:00:46.332536 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e8d2e-050a-43c2-8eaf-a89e80ccf2f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:00:46.332821 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e8d2e-050a-43c2-8eaf-a89e80ccf2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:00:46.333094 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345e8d2e-050a-43c2-8eaf-a89e80ccf2f8 admin admin] PATH_INFO: `/v3/projects/df9cf02a012f4994b30eb716f74b04f7` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:00:46.334291 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e8d2e-050a-43c2-8eaf-a89e80ccf2f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df9cf02a012f4994b30eb716f74b04f7)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:00:46.336392 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345e8d2e-050a-43c2-8eaf-a89e80ccf2f8 admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:00:46.486162 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:00:46.487385 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-345e8d2e-050a-43c2-8eaf-a89e80ccf2f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df9cf02a012f4994b30eb716f74b04f7', 'request_id': 'req-345e8d2e-050a-43c2-8eaf-a89e80ccf2f8'} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:00:46.494387 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-345e8d2e-050a-43c2-8eaf-a89e80ccf2f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df9cf02a012f4994b30eb716f74b04f7', 'request_id': 'req-345e8d2e-050a-43c2-8eaf-a89e80ccf2f8'} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:00:46.501209 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-345e8d2e-050a-43c2-8eaf-a89e80ccf2f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df9cf02a012f4994b30eb716f74b04f7', 'request_id': 'req-345e8d2e-050a-43c2-8eaf-a89e80ccf2f8'} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:00:46.593973 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-345e8d2e-050a-43c2-8eaf-a89e80ccf2f8 admin admin] The token cache is being invalidate because project df9cf02a012f4994b30eb716f74b04f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:00:46.594289 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-345e8d2e-050a-43c2-8eaf-a89e80ccf2f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:00:46.595220 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-345e8d2e-050a-43c2-8eaf-a89e80ccf2f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:00:46.597181 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 628/1229] 10.222.0.62 () {58 vars in 1232 bytes} [Wed May 25 16:00:46 2022] DELETE /identity/v3/projects/df9cf02a012f4994b30eb716f74b04f7 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:00:46.601821 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66d857-1c13-437b-b1f6-0c47d0885be7 admin admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:00:46.606115 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-0b66d857-1c13-437b-b1f6-0c47d0885be7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:00:46.618430 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66d857-1c13-437b-b1f6-0c47d0885be7 admin admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:00:46.662066 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:00:46.679567 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c30d7b-9e1b-4e41-8b6c-eb99b2ce50a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:00:46.681790 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c30d7b-9e1b-4e41-8b6c-eb99b2ce50a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:00:46.686212 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c30d7b-9e1b-4e41-8b6c-eb99b2ce50a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:00:46.686212 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c30d7b-9e1b-4e41-8b6c-eb99b2ce50a8 admin admin] PATH_INFO: `/v3/users/7d44287084874e1abdf2326c2e7565fe` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:00:46.686212 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c30d7b-9e1b-4e41-8b6c-eb99b2ce50a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d44287084874e1abdf2326c2e7565fe)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:00:46.686212 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c30d7b-9e1b-4e41-8b6c-eb99b2ce50a8 admin admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:00:46.895650 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-49c30d7b-9e1b-4e41-8b6c-eb99b2ce50a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d44287084874e1abdf2326c2e7565fe'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:00:46.896355 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-49c30d7b-9e1b-4e41-8b6c-eb99b2ce50a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d44287084874e1abdf2326c2e7565fe'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:00:46.903869 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-49c30d7b-9e1b-4e41-8b6c-eb99b2ce50a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d44287084874e1abdf2326c2e7565fe'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:00:46.916106 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-49c30d7b-9e1b-4e41-8b6c-eb99b2ce50a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d44287084874e1abdf2326c2e7565fe'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:00:46.916994 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-49c30d7b-9e1b-4e41-8b6c-eb99b2ce50a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d44287084874e1abdf2326c2e7565fe'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:00:47.073050 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 602/1230] 10.222.0.62 () {58 vars in 1223 bytes} [Wed May 25 16:00:46 2022] DELETE /identity/v3/users/7d44287084874e1abdf2326c2e7565fe => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:00:47.404604 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e8d2e-050a-43c2-8eaf-a89e80ccf2f8 admin admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:00:47.406414 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-345e8d2e-050a-43c2-8eaf-a89e80ccf2f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:00:47.429468 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345e8d2e-050a-43c2-8eaf-a89e80ccf2f8 admin admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:00:47.496385 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90963c3-3071-43fc-a48d-3331bc73d373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:00:47.497319 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90963c3-3071-43fc-a48d-3331bc73d373 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:00:47.498204 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90963c3-3071-43fc-a48d-3331bc73d373 admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:00:47.498204 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90963c3-3071-43fc-a48d-3331bc73d373 admin admin] PATH_INFO: `/v3/projects/d7a3468f08584ff8b73fd7ebc4041277` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:00:47.499205 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90963c3-3071-43fc-a48d-3331bc73d373 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a3468f08584ff8b73fd7ebc4041277)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:00:47.501182 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90963c3-3071-43fc-a48d-3331bc73d373 admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:00:47.611831 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-b90963c3-3071-43fc-a48d-3331bc73d373 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a3468f08584ff8b73fd7ebc4041277', 'request_id': 'req-b90963c3-3071-43fc-a48d-3331bc73d373'} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:00:47.618224 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-b90963c3-3071-43fc-a48d-3331bc73d373 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a3468f08584ff8b73fd7ebc4041277', 'request_id': 'req-b90963c3-3071-43fc-a48d-3331bc73d373'} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:00:47.625189 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-b90963c3-3071-43fc-a48d-3331bc73d373 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a3468f08584ff8b73fd7ebc4041277', 'request_id': 'req-b90963c3-3071-43fc-a48d-3331bc73d373'} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:00:47.682529 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-b90963c3-3071-43fc-a48d-3331bc73d373 admin admin] The token cache is being invalidate because project d7a3468f08584ff8b73fd7ebc4041277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:00:47.682529 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-b90963c3-3071-43fc-a48d-3331bc73d373 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:00:47.682783 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-b90963c3-3071-43fc-a48d-3331bc73d373 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:00:47.684520 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 629/1231] 10.222.0.62 () {58 vars in 1232 bytes} [Wed May 25 16:00:47 2022] DELETE /identity/v3/projects/d7a3468f08584ff8b73fd7ebc4041277 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:00:57.367722 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=34,keystone:DELETE=10,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:00:57.677382 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=63,keystone:DELETE=10,keystone:INSERT=2 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:01:08.701692 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabfc9f-064b-40f8-b10e-3a3b8afeb45a None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:01:08.702258 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabfc9f-064b-40f8-b10e-3a3b8afeb45a None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:01:08.702258 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabfc9f-064b-40f8-b10e-3a3b8afeb45a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:01:08.721175 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-7fabfc9f-064b-40f8-b10e-3a3b8afeb45a None None] MFA Rules not processed for user `289049c0c6454660ad11417484de67a9`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:01:08.722994 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-7fabfc9f-064b-40f8-b10e-3a3b8afeb45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:01:08.782175 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 603/1232] 10.222.0.62 () {58 vars in 957 bytes} [Wed May 25 16:01:08 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 16:01:09.052836 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbdcd3-0d97-4c68-86e5-1e48ac2aaf77 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:01:09.054267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbdcd3-0d97-4c68-86e5-1e48ac2aaf77 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:01:09.054267 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cbdcd3-0d97-4c68-86e5-1e48ac2aaf77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:01:09.101268 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-26cbdcd3-0d97-4c68-86e5-1e48ac2aaf77 None None] MFA Rules not processed for user `d1cb7a1be78c4b55b5ec991b99d47020`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:01:09.102531 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-26cbdcd3-0d97-4c68-86e5-1e48ac2aaf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:01:09.167141 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 630/1233] 10.222.0.62 () {58 vars in 1009 bytes} [Wed May 25 16:01:09 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:01:09.179329 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabfc9f-064b-40f8-b10e-3a3b8afeb45a None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:01:09.180763 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-7fabfc9f-064b-40f8-b10e-3a3b8afeb45a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:01:09.192370 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabfc9f-064b-40f8-b10e-3a3b8afeb45a None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:01:09.195955 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc428d-9d92-4406-aa91-f1bf7e5223b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:01:09.196628 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc428d-9d92-4406-aa91-f1bf7e5223b1 service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:01:09.196908 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc428d-9d92-4406-aa91-f1bf7e5223b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:01:09.197178 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc428d-9d92-4406-aa91-f1bf7e5223b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:01:09.204664 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc428d-9d92-4406-aa91-f1bf7e5223b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:01:09.206311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc428d-9d92-4406-aa91-f1bf7e5223b1 service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:01:09.215106 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 604/1234] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 16:01:09 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:01:19.163587 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=38 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:01:19.211250 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=31 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:01:23.921445 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbdcd3-0d97-4c68-86e5-1e48ac2aaf77 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:01:23.922831 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-26cbdcd3-0d97-4c68-86e5-1e48ac2aaf77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:01:23.999008 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cbdcd3-0d97-4c68-86e5-1e48ac2aaf77 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:01:24.004801 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a292473d-d5d8-4345-829c-ccc8643744d9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2506613903044131b9e8c75196de862b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:01:24.005470 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292473d-d5d8-4345-829c-ccc8643744d9 service placement] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:01:24.005759 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292473d-d5d8-4345-829c-ccc8643744d9 service placement] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:01:24.006040 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a292473d-d5d8-4345-829c-ccc8643744d9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:01:24.007895 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-a292473d-d5d8-4345-829c-ccc8643744d9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:01:24.021155 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292473d-d5d8-4345-829c-ccc8643744d9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:01:24.022839 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a292473d-d5d8-4345-829c-ccc8643744d9 service placement] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:01:24.033118 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 631/1235] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 16:01:23 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:01:24.461718 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3333a-2a06-4544-97a8-562b6a8a6019 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:01:24.462218 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3333a-2a06-4544-97a8-562b6a8a6019 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:01:24.462311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3333a-2a06-4544-97a8-562b6a8a6019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:01:24.482036 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-a4f3333a-2a06-4544-97a8-562b6a8a6019 None None] MFA Rules not processed for user `289049c0c6454660ad11417484de67a9`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:01:24.484512 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-a4f3333a-2a06-4544-97a8-562b6a8a6019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:01:24.490711 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 605/1236] 10.222.0.62 () {58 vars in 957 bytes} [Wed May 25 16:01:24 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:01:34.028967 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=32 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:01:34.476654 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=3 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:02:45.930969 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8058854-43bc-4fdb-b5fb-863af9b0bbc9 None None] REQUEST_METHOD: `POST` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:02:45.931487 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8058854-43bc-4fdb-b5fb-863af9b0bbc9 None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:02:45.931487 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8058854-43bc-4fdb-b5fb-863af9b0bbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:02:45.949276 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.auth.core [None req-d8058854-43bc-4fdb-b5fb-863af9b0bbc9 None None] MFA Rules not processed for user `289049c0c6454660ad11417484de67a9`. Rule list: `[]` (Enabled: `True`). {{(pid=99258) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:02:45.950651 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-d8058854-43bc-4fdb-b5fb-863af9b0bbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:02:45.957818 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 632/1237] 10.222.0.62 () {58 vars in 957 bytes} [Wed May 25 16:02:45 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:02:55.943449 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=3 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:03:01.206341 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3333a-2a06-4544-97a8-562b6a8a6019 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:03:01.216358 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3333a-2a06-4544-97a8-562b6a8a6019 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:03:01.220390 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa270f-8c8a-47e5-9a74-df4fd647ae08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:03:01.220828 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa270f-8c8a-47e5-9a74-df4fd647ae08 service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:03:01.220978 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa270f-8c8a-47e5-9a74-df4fd647ae08 service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:03:01.221249 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aa270f-8c8a-47e5-9a74-df4fd647ae08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:03:01.223261 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-45aa270f-8c8a-47e5-9a74-df4fd647ae08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:03:01.286245 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa270f-8c8a-47e5-9a74-df4fd647ae08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:03:01.287750 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aa270f-8c8a-47e5-9a74-df4fd647ae08 service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:03:01.297538 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 606/1238] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 16:03:01 2022] GET /identity/v3/auth/tokens => generated 2871 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:03:11.293256 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=30 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:04:27.248846 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8058854-43bc-4fdb-b5fb-863af9b0bbc9 None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:04:27.259863 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8058854-43bc-4fdb-b5fb-863af9b0bbc9 None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:04:27.265313 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1cabb7-e903-4757-bc9c-09384be4b92b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:04:27.266023 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cabb7-e903-4757-bc9c-09384be4b92b service neutron] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:04:27.266285 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cabb7-e903-4757-bc9c-09384be4b92b service neutron] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:04:27.266567 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1cabb7-e903-4757-bc9c-09384be4b92b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:04:27.268482 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-ad1cabb7-e903-4757-bc9c-09384be4b92b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:04:27.283781 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1cabb7-e903-4757-bc9c-09384be4b92b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:04:27.285628 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1cabb7-e903-4757-bc9c-09384be4b92b service neutron] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:04:27.294580 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 633/1239] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 16:04:27 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:04:37.290659 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=6 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:24.366692 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa270f-8c8a-47e5-9a74-df4fd647ae08 service neutron] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:24.368192 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-45aa270f-8c8a-47e5-9a74-df4fd647ae08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:06:24.461047 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aa270f-8c8a-47e5-9a74-df4fd647ae08 service neutron] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:24.466501 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e13ab2e-cc3a-466e-93f8-37a4945d455c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:24.467642 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13ab2e-cc3a-466e-93f8-37a4945d455c service nova] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:24.468323 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13ab2e-cc3a-466e-93f8-37a4945d455c service nova] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:24.468323 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e13ab2e-cc3a-466e-93f8-37a4945d455c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:24.473944 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-7e13ab2e-cc3a-466e-93f8-37a4945d455c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:06:24.480764 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13ab2e-cc3a-466e-93f8-37a4945d455c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:24.482372 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e13ab2e-cc3a-466e-93f8-37a4945d455c service nova] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:24.492140 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 607/1240] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 16:06:24 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:06:26.467147 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65e153-3d90-4bb3-9cb9-6a673653491d None None] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:26.468295 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65e153-3d90-4bb3-9cb9-6a673653491d None None] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:26.469022 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a65e153-3d90-4bb3-9cb9-6a673653491d None None] PATH_INFO: `/` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:26.470988 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 634/1241] 10.222.0.62 () {54 vars in 921 bytes} [Wed May 25 16:06:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 16:06:26.476054 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f5d44-fced-45a8-a9a7-af5c5d2505d8 None None] REQUEST_METHOD: `POST` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:26.476586 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f5d44-fced-45a8-a9a7-af5c5d2505d8 None None] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:26.476669 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6f5d44-fced-45a8-a9a7-af5c5d2505d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:26.524474 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.auth.core [None req-3a6f5d44-fced-45a8-a9a7-af5c5d2505d8 None None] MFA Rules not processed for user `d9b8b255e35c4949ba8faeb79921f141`. Rule list: `[]` (Enabled: `True`). {{(pid=99259) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 16:06:26.527227 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-3a6f5d44-fced-45a8-a9a7-af5c5d2505d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:06:26.535454 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 608/1242] 10.222.0.62 () {58 vars in 1018 bytes} [Wed May 25 16:06:26 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 16:06:26.548384 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65e153-3d90-4bb3-9cb9-6a673653491d None None] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:26.564374 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a65e153-3d90-4bb3-9cb9-6a673653491d None None] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:26.569641 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dff9f-eae7-4a45-b671-c250f682dc2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd9b8b255e35c4949ba8faeb79921f141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:26.570258 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dff9f-eae7-4a45-b671-c250f682dc2e service nova] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:26.570549 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dff9f-eae7-4a45-b671-c250f682dc2e service nova] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:26.570830 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17dff9f-eae7-4a45-b671-c250f682dc2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:26.580464 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dff9f-eae7-4a45-b671-c250f682dc2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:26.582143 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17dff9f-eae7-4a45-b671-c250f682dc2e service nova] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:26.593522 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 635/1243] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 16:06:26 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:06:26.836641 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f5d44-fced-45a8-a9a7-af5c5d2505d8 None None] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:26.846747 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6f5d44-fced-45a8-a9a7-af5c5d2505d8 None None] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:26.850581 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510b38a-44fa-4a82-88dd-2e42a731a3b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:26.851248 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510b38a-44fa-4a82-88dd-2e42a731a3b3 service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:26.851531 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510b38a-44fa-4a82-88dd-2e42a731a3b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:26.851803 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2510b38a-44fa-4a82-88dd-2e42a731a3b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:26.853734 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-2510b38a-44fa-4a82-88dd-2e42a731a3b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:06:26.867362 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510b38a-44fa-4a82-88dd-2e42a731a3b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:26.868851 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2510b38a-44fa-4a82-88dd-2e42a731a3b3 service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:26.880274 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 609/1244] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 16:06:26 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:06:26.971438 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dff9f-eae7-4a45-b671-c250f682dc2e service nova] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:26.972930 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-a17dff9f-eae7-4a45-b671-c250f682dc2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:06:27.006293 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17dff9f-eae7-4a45-b671-c250f682dc2e service nova] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:27.013392 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e615cf9-9e81-476e-9a44-19791e858105 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2506613903044131b9e8c75196de862b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:27.015088 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e615cf9-9e81-476e-9a44-19791e858105 service placement] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:27.015394 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e615cf9-9e81-476e-9a44-19791e858105 service placement] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:27.015876 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e615cf9-9e81-476e-9a44-19791e858105 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:27.026406 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e615cf9-9e81-476e-9a44-19791e858105 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:27.036354 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e615cf9-9e81-476e-9a44-19791e858105 service placement] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:27.052241 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 636/1245] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 16:06:26 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:06:28.165002 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510b38a-44fa-4a82-88dd-2e42a731a3b3 service neutron] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:28.174835 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2510b38a-44fa-4a82-88dd-2e42a731a3b3 service neutron] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:28.178955 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f55647-18d0-4783-b012-4cbaa49d3ab0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:28.186022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f55647-18d0-4783-b012-4cbaa49d3ab0 service neutron] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:28.186022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f55647-18d0-4783-b012-4cbaa49d3ab0 service neutron] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:28.186022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f55647-18d0-4783-b012-4cbaa49d3ab0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:28.186022 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-a9f55647-18d0-4783-b012-4cbaa49d3ab0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:06:28.197633 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f55647-18d0-4783-b012-4cbaa49d3ab0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:28.199222 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f55647-18d0-4783-b012-4cbaa49d3ab0 service neutron] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:28.211353 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 610/1246] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 16:06:28 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:06:37.043501 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=17 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:38.206424 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=62 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:38.593226 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e615cf9-9e81-476e-9a44-19791e858105 service placement] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:38.594707 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-2e615cf9-9e81-476e-9a44-19791e858105 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:06:38.607977 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e615cf9-9e81-476e-9a44-19791e858105 service placement] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:38.611715 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce59493-beb4-4184-ad5c-3851eba9fefd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd1cb7a1be78c4b55b5ec991b99d47020', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:38.612348 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce59493-beb4-4184-ad5c-3851eba9fefd service neutron] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:38.612665 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce59493-beb4-4184-ad5c-3851eba9fefd service neutron] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:38.612943 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce59493-beb4-4184-ad5c-3851eba9fefd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:38.615921 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-4ce59493-beb4-4184-ad5c-3851eba9fefd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:06:38.682644 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce59493-beb4-4184-ad5c-3851eba9fefd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:38.684071 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce59493-beb4-4184-ad5c-3851eba9fefd service neutron] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:38.693766 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 637/1247] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 16:06:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:06:41.991376 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f55647-18d0-4783-b012-4cbaa49d3ab0 service neutron] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:42.015181 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f55647-18d0-4783-b012-4cbaa49d3ab0 service neutron] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:42.023118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4e1d7-5067-40d4-860a-d9a121c9f92e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2506613903044131b9e8c75196de862b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:42.023118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4e1d7-5067-40d4-860a-d9a121c9f92e service placement] REQUEST_METHOD: `GET` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:42.023118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4e1d7-5067-40d4-860a-d9a121c9f92e service placement] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:42.023118 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4e1d7-5067-40d4-860a-d9a121c9f92e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:42.024218 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-04b4e1d7-5067-40d4-860a-d9a121c9f92e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:06:42.036959 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4e1d7-5067-40d4-860a-d9a121c9f92e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:42.039312 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4e1d7-5067-40d4-860a-d9a121c9f92e service placement] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:42.049865 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 611/1248] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 16:06:41 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:06:45.579528 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce59493-beb4-4184-ad5c-3851eba9fefd service neutron] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:45.592966 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce59493-beb4-4184-ad5c-3851eba9fefd service neutron] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:45.598092 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f02fd9-1d78-4222-95fa-127f3a792c8d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2506613903044131b9e8c75196de862b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5e951a6f0d6947dfae3ac132afbcd4b5', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:45.599294 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f02fd9-1d78-4222-95fa-127f3a792c8d service placement] REQUEST_METHOD: `GET` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:45.609614 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f02fd9-1d78-4222-95fa-127f3a792c8d service placement] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:45.609614 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f02fd9-1d78-4222-95fa-127f3a792c8d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:45.609614 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-77f02fd9-1d78-4222-95fa-127f3a792c8d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:06:45.613751 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f02fd9-1d78-4222-95fa-127f3a792c8d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:45.615979 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f02fd9-1d78-4222-95fa-127f3a792c8d service placement] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:45.626497 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 638/1249] 10.222.0.62 () {60 vars in 1365 bytes} [Wed May 25 16:06:45 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 16:06:45.673984 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4e1d7-5067-40d4-860a-d9a121c9f92e service placement] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:45.675374 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-04b4e1d7-5067-40d4-860a-d9a121c9f92e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:06:45.689478 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4e1d7-5067-40d4-860a-d9a121c9f92e service placement] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:45.694504 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5cd30-69f1-4842-a285-e990dfe2f2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:45.695452 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5cd30-69f1-4842-a285-e990dfe2f2bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:45.695737 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5cd30-69f1-4842-a285-e990dfe2f2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:45.696018 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5cd30-69f1-4842-a285-e990dfe2f2bf admin admin] PATH_INFO: `/v3/users/289049c0c6454660ad11417484de67a9` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:45.697231 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5cd30-69f1-4842-a285-e990dfe2f2bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=289049c0c6454660ad11417484de67a9)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:45.699135 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f5cd30-69f1-4842-a285-e990dfe2f2bf admin admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:45.876452 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-92f5cd30-69f1-4842-a285-e990dfe2f2bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '289049c0c6454660ad11417484de67a9'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:06:45.877189 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-92f5cd30-69f1-4842-a285-e990dfe2f2bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '289049c0c6454660ad11417484de67a9'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:06:45.884188 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-92f5cd30-69f1-4842-a285-e990dfe2f2bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '289049c0c6454660ad11417484de67a9'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:06:45.896878 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-92f5cd30-69f1-4842-a285-e990dfe2f2bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '289049c0c6454660ad11417484de67a9'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:06:45.897589 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-92f5cd30-69f1-4842-a285-e990dfe2f2bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '289049c0c6454660ad11417484de67a9'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:06:45.987822 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 612/1250] 10.222.0.62 () {58 vars in 1223 bytes} [Wed May 25 16:06:45 2022] DELETE /identity/v3/users/289049c0c6454660ad11417484de67a9 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:06:46.294324 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f02fd9-1d78-4222-95fa-127f3a792c8d service placement] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:46.306719 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f02fd9-1d78-4222-95fa-127f3a792c8d service placement] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:46.367632 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc63a6-7984-4db0-bc3d-3f43d51d669a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:46.368574 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc63a6-7984-4db0-bc3d-3f43d51d669a admin admin] REQUEST_METHOD: `DELETE` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:46.368863 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc63a6-7984-4db0-bc3d-3f43d51d669a admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:46.369138 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc63a6-7984-4db0-bc3d-3f43d51d669a admin admin] PATH_INFO: `/v3/projects/847ca411098e4f8695ca267497f7e6d0` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:46.370388 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc63a6-7984-4db0-bc3d-3f43d51d669a admin admin] RBAC: Authorizing `identity:delete_project(project_id=847ca411098e4f8695ca267497f7e6d0)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:46.372342 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc63a6-7984-4db0-bc3d-3f43d51d669a admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:46.467426 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-a7fc63a6-7984-4db0-bc3d-3f43d51d669a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847ca411098e4f8695ca267497f7e6d0', 'request_id': 'req-a7fc63a6-7984-4db0-bc3d-3f43d51d669a'} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:06:46.473112 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-a7fc63a6-7984-4db0-bc3d-3f43d51d669a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847ca411098e4f8695ca267497f7e6d0', 'request_id': 'req-a7fc63a6-7984-4db0-bc3d-3f43d51d669a'} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:06:46.481651 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-a7fc63a6-7984-4db0-bc3d-3f43d51d669a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847ca411098e4f8695ca267497f7e6d0', 'request_id': 'req-a7fc63a6-7984-4db0-bc3d-3f43d51d669a'} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:06:46.587690 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-a7fc63a6-7984-4db0-bc3d-3f43d51d669a admin admin] The token cache is being invalidate because project 847ca411098e4f8695ca267497f7e6d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:06:46.588452 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-a7fc63a6-7984-4db0-bc3d-3f43d51d669a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:06:46.589034 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-a7fc63a6-7984-4db0-bc3d-3f43d51d669a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:06:46.590764 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 639/1251] 10.222.0.62 () {58 vars in 1232 bytes} [Wed May 25 16:06:46 2022] DELETE /identity/v3/projects/847ca411098e4f8695ca267497f7e6d0 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:06:46.594681 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5cd30-69f1-4842-a285-e990dfe2f2bf admin admin] Authenticating user token {{(pid=99259) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:46.596061 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.fernet_utils [None req-92f5cd30-69f1-4842-a285-e990dfe2f2bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99259) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:06:46.610311 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f5cd30-69f1-4842-a285-e990dfe2f2bf admin admin] Validating token access rules against request {{(pid=99259) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:46.668909 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9489f6a4-8223-4ac1-9f1c-f4a4f187803d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99259) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:46.669801 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489f6a4-8223-4ac1-9f1c-f4a4f187803d admin admin] REQUEST_METHOD: `DELETE` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:46.670089 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489f6a4-8223-4ac1-9f1c-f4a4f187803d admin admin] SCRIPT_NAME: `/identity` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:46.670369 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9489f6a4-8223-4ac1-9f1c-f4a4f187803d admin admin] PATH_INFO: `/v3/users/e902af1bd98f4621a68c983535eb5f4d` {{(pid=99259) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:46.671697 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489f6a4-8223-4ac1-9f1c-f4a4f187803d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e902af1bd98f4621a68c983535eb5f4d)` {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:46.673797 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9489f6a4-8223-4ac1-9f1c-f4a4f187803d admin admin] RBAC: Authorization granted {{(pid=99259) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:46.818274 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-9489f6a4-8223-4ac1-9f1c-f4a4f187803d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e902af1bd98f4621a68c983535eb5f4d'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:06:46.818916 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-9489f6a4-8223-4ac1-9f1c-f4a4f187803d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e902af1bd98f4621a68c983535eb5f4d'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:06:46.825920 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-9489f6a4-8223-4ac1-9f1c-f4a4f187803d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e902af1bd98f4621a68c983535eb5f4d'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:06:46.831418 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:46.842166 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-9489f6a4-8223-4ac1-9f1c-f4a4f187803d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e902af1bd98f4621a68c983535eb5f4d'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:06:46.842802 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG keystone.notifications [None req-9489f6a4-8223-4ac1-9f1c-f4a4f187803d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e902af1bd98f4621a68c983535eb5f4d'} {{(pid=99259) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:06:46.889575 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: [pid: 99259|app: 0|req: 613/1252] 10.222.0.62 () {58 vars in 1223 bytes} [Wed May 25 16:06:46 2022] DELETE /identity/v3/users/e902af1bd98f4621a68c983535eb5f4d => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:06:47.122047 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc63a6-7984-4db0-bc3d-3f43d51d669a admin admin] Authenticating user token {{(pid=99258) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 16:06:47.122530 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.fernet_utils [None req-a7fc63a6-7984-4db0-bc3d-3f43d51d669a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=99258) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 16:06:47.137305 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc63a6-7984-4db0-bc3d-3f43d51d669a admin admin] Validating token access rules against request {{(pid=99258) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 16:06:47.146628 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:47.199908 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf3b90-8076-47f2-a7be-f1ab475aacf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c9c77caa8ec1422eb63723b3db112685', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7b5e6c2944d540b0b18682f21c8da32d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=99258) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 16:06:47.200837 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf3b90-8076-47f2-a7be-f1ab475aacf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 16:06:47.201125 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf3b90-8076-47f2-a7be-f1ab475aacf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 16:06:47.201402 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf3b90-8076-47f2-a7be-f1ab475aacf2 admin admin] PATH_INFO: `/v3/projects/af7064bfec4b4f649a14fdcc70235453` {{(pid=99258) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 16:06:47.202596 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf3b90-8076-47f2-a7be-f1ab475aacf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af7064bfec4b4f649a14fdcc70235453)` {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 16:06:47.204625 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaf3b90-8076-47f2-a7be-f1ab475aacf2 admin admin] RBAC: Authorization granted {{(pid=99258) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 16:06:47.331471 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-bdaf3b90-8076-47f2-a7be-f1ab475aacf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af7064bfec4b4f649a14fdcc70235453', 'request_id': 'req-bdaf3b90-8076-47f2-a7be-f1ab475aacf2'} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:06:47.337766 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-bdaf3b90-8076-47f2-a7be-f1ab475aacf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af7064bfec4b4f649a14fdcc70235453', 'request_id': 'req-bdaf3b90-8076-47f2-a7be-f1ab475aacf2'} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:06:47.344177 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-bdaf3b90-8076-47f2-a7be-f1ab475aacf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af7064bfec4b4f649a14fdcc70235453', 'request_id': 'req-bdaf3b90-8076-47f2-a7be-f1ab475aacf2'} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:06:47.409771 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-bdaf3b90-8076-47f2-a7be-f1ab475aacf2 admin admin] The token cache is being invalidate because project af7064bfec4b4f649a14fdcc70235453 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=99258) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 16:06:47.409968 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-bdaf3b90-8076-47f2-a7be-f1ab475aacf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:06:47.410585 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG keystone.notifications [None req-bdaf3b90-8076-47f2-a7be-f1ab475aacf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=99258) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 16:06:47.412195 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: [pid: 99258|app: 0|req: 640/1253] 10.222.0.62 () {58 vars in 1232 bytes} [Wed May 25 16:06:47 2022] DELETE /identity/v3/projects/af7064bfec4b4f649a14fdcc70235453 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 16:06:56.935783 dv-osbrick-836391-10-ceph devstack@keystone.service[99259]: DEBUG dbcounter [-] [99259] Writing DB stats keystone:DELETE=3,keystone:SELECT=6,keystone:INSERT=1 {{(pid=99259) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 16:06:57.416501 dv-osbrick-836391-10-ceph devstack@keystone.service[99258]: DEBUG dbcounter [-] [99258] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=99258) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}